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ABSTRACT 


This thesis represented a study of the issue of Learner 
Control (LC} in Computer Based Instruction (CBI). The Lc 
issue is a complex one and involves a number of different 
aspects. This includes the problen of who is to have the 
power of control over the content and direction of 
instruction. Another aspect of the issue is the question of 
whether instruction can be better adapted to individual 
differences through the instructor's selection of parameters 
or through the student's selection. A third component of the 
issue has to do with the instructional design considerations 
of task sequencing, instructional strategies, nedia 
selection, etc. These three major aspects as well as the 
results of past research on LC were brought together in the 


formulation of a theoretical framework for LC. 


This framework was used as a basis for a study of LC in 
the context of a computer-based course to teach the 
programming language APL to high school | and university 
students. The study provided some students with full control 
over concept or topic sequencing, instructional mode, amount 
Oteepractice, aditticuity level, and a @number) "of (ouher 
features, other students with optional control, and a third 


group with no control. 
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The total completion times, average number correct, learning 
rate, and attitude measures were compared among the three LC 
conditions. Measures of internal/external locus of control 
and programming and mathematical background were also 
compared among the groups. The overall results of the study 
suggested that increased degrees of LC as implemented had no 
beneficial effects on the performance Ons attitudinal 
measures in the context of tutorial APL instruction. Nor was 
any relationship found between the personality or preskill 


measures and the use of LC. 


The conclusions ot the study identified inadequacies in 
the theoretical framework and discussed the role of LC in 
the present and future development of CBI. It was suggested 
that the tutorial mode of instruction tends to mask the 
pocential benefits cf LC and that these benefits may be more 
obvious in a problem solving or socratic type of CBI where 
the learner must play a more active role during instruction. 
It was also suggested that LC can not be properly 
implemented cb aen oe On Eas, Oy a Wd bee yee have the capability to 
qualitatively represent the conceptual structure of the 
student in terms of the skills or components of the task or 


subject matter. 
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be Thetissue of iLearner Control (LC). 


Computer Assisted Instruction (CAT) and Computer 
Assisted Learning (CAL) are two terms commonly used to 
describe the instructional use of the computer. The 
difference between these two terms is not trivial. Rather, 
it reflects quite different (and often antagonistic) 
approaches or orientations to the use of computers in 
education. Those who advocate the CAL position feel that the 
computer should be’ a tool of the student -- a tool which 
broadens the scope or depth of learning activities. Thus, 
the student should learn how to use computers in order to 
utilize large data bases, perform calculations, analyze 
data, construct Simulation models or even create games. 
Luehrmann (1972) states this viewpoint as follows: 
Computing constitutes a new and Fundamental 
intellectual resource. To use that resource as a mere 
delivery system for instruction, but not to give a 
student instruction in how he might use the resource 
hinself, has been the chief failure of the CAI effort. 
What a loss of opportunity if the skill of computing 
were to be harnessed for the purpose of turning out 
masses of students who are unable to use computing. 
(pe 44) 

Other vocal supporters of CAL have been Papert and his 

crusade for the use of the computer language LOGO (@.g., 

Papert & Solomon, 1972), Dwyer (1974) and his SoOLOworks 


project, and Pelee (1974) who has argued for the use of 
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"glass boxes" in teaching APL. 


In contrast, those who hold the CAI perspective 
conceptualize the computer as a tool of the instructor -~ a 
tool which can increase the effectiveness of teaching by 
virtue of controlled and monitored delivery. In this 
conceptualization, the basic theory associated with CAI is 
one of control or adaptation; how to optimize the student's 
trajectory through a curriculum to produce the best 
performance in the least time. The best examples of this 
Viewpoint are the drill & practice programs developed at 
Stanford in arithmetic and reading (Atkinson, 1972; Suppes & 
Morningstar, 1972). AS Atkinson (1976) says: 

Some have argued that any attempt to devise optimal 
strategies is doomed to failure, and that the learner 
is the best judge of appropriate instructional 
actions. I am not sympathetic to a learner-controlled 
approach to instruction) tsbecause, +I believe, pits 
advocates are trying to avoid the difficult but 
chailenging task of developing a theory of 
instruction. ip. 406) 
Pask (1975) and Landa (1974) are other researchers who have 
approached CATie£ro@ita weontrol Ltheoryisor-e"cybernetic® 


perspective. 


The distinction between CAL and CAI reflects a basic 
conflict in beliefs or educational philosophies. In fact the 


CAL — CAI conflict is the most recent version of an enduring 
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power struggle in education over who should control the 
course and nature of learning. Classical thinkers such as 
Plato, Socrates, Rousseau, and Locke all took positions on 
this issue. Contemporary statements of the two sides are 
given by Rogers (1972) in Freedom to Learn and by Skinner 
(1968) in The Technology of Teaching. Furthermore, learner 
control is a major aspect of many other educational 
controversies or innovations such as Summerhill and the 
"free school" movement,deschooling society (Illich, 1970) or 
dialogics (Freire, 1972). Thus the issue of learner control 
is not unique to computer-based education but is a general 


issue in educational theory. 


Advocates of CAI see the use of the computer by the 
student to solve problems or search data bases as particular 
types of instructional modes, e.ge, Simulations, inquiry, 
drill & practice, tutorial, etc., which are matched to the 
requirements of the task or subject Matter. CAL advocates, 
on the other hand, consider CAI as one, somewhat limited, 
use of the computer as a learning tool.! When CAL and CAT 
are seen as dichotomous positions, there is little hope of 
making any useful progress in resolving differences. The 
difference between CAI and CAL is the degree and type of 
learner control permitted. Thus the amount of student 
control can range over a number of different parameters 
1. Indeed, hae & Solomon (1972) suggest CAI as only one 


of 20 possible topics in their fifth grade computer science 
course. 
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involved in learning. These parameters include pacing, 
sequencing, amount of practice, difficulty, media selection, 
learning styles, and experience with learner control. The 
useful question to ask is what parameters are better left in 
the hands of the student and which in the hands of the 
instructor in terms of student performance or satisfaction. 
In other words, the question is not really who is to control 
instruction, but who controls what and how. The present 


thesis addresses this question. 


Part of the learner control issue derives from the 
pejorative connotations of the word "control". It is often 
interpreted in the sense of coercion or manipulation. 
However, control actually has a generically neutral meaning, 
i.e, the influence of one system on another. In the case of 
instruction we usually think of the influence of a "teacher" 
on a "student". However, a student influences gtemner own 
learning, .i.e. self-control. As. Landa (1977, p.8)- points 
out: "the end goal of instructional control is to produce in 
the student the ability for self-control, which includes as 
its component, the ability for independent goal setting". As 
this quote suggests, teacher and student control are 
progressive stages of the instructional / learning process. 
As the student continues with formal education, the 
instruction becomes more self-directed and -. less teacher 
directed. However, the rate of this progression will depend 
upon the age, experience, and motivation of the learner. A 


further remark by Landa outlines the problem of power 
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involved in this transition: “Each increase in the 
development of self-control abilities must be followed by a 
corresponding weakening of the external control and a 
handing over of the corresponding functions of control to 
the student himself" (p. 8). In other words, the teacher 
must be willing to accept the proposition that students can 
learn better on their own than under the direction of the 


teacher. 


Much of this same problem also has to do with the 
evaluation or standards of education. It can be argued that 
there are certain subject matters or instructional contexts 
in which allowing student control is undesirable in terms of 
maintaining necessary educational standards. Thus in the 
case of children learning to read, medical students or pilot 
training, for example, it is argued that mastery (or some 
minimal level of performance) must be guaranteed Ane that 
permitting the student to control the selection or 
sequencing of topics or the amount of practice would 
jeopardize this. This argument is basically about who has 
the power to set the standards or criteria of instruction, 
i.e., whether the responsibility will be in the hands of the 


student or instructor. 


A second facet of the learner control issue, confounded 
with the first, has to do with the individualization of 
instruction, i.e., the mechanism for provding each student 


with a unique learning experience tailored to their 
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particular learning styles, preskills, or personality type. 
One approach to individualization (the adaptive approach) is 
based upon the idea of using the student's past response 
history in a task to alter the course or nature of future 
instruction. This approach may involve changing difficulty 
level, mode of instruction, or amount of practice based upon 
recent or cumulative performance. The Stanford drill & 
practice prograns are examples of this type of 
individualization. Another approach to individualization in 
CAI involves uSing aptitude and personality measures (the 
trait approach). To use this approach one must be able to 
associate individual difference measures with particular 
instructional parameters. An enormous body of literature on 
Aptitude Treatment Interaction (ATT) research exists 
(reviewed in Cronbach & Snow, 1977) and there have been 
specific proposals about how to relate individual 
differences measures to instructional parameters. (e.g., 
Stolurow, 1972). However, Merrill. (1975) has argued thats . 

A given person never has exactly the sane 

configuration of these momentary aptitudes twice in 

his life. Consequently, the search for the interaction 

of stable trait aptitudes and fixed treatments is 

never likely to be of instructional value. (p.- 221) 
Instead Merrill argues that individuals should be given a 
means of adapting the learning materials to their aptitudes 
and styles and that such learning strategies or tactics 


should be changeable during the course of learning. Merrill 


im 


» ‘ 5 ns = iG 6 
i NY PERS oe. “SPOR SS 6 Oe ee 
ee ee eae hee i Oa 
7 = ’ A 
: bo ‘ eh ewa oe “4 
Z 4 ‘ a ae ae sy ss ve Ae p ’ cy 
tv a , ia & ae SE! Pla? It et oe na” 
7 = : i eS Wo a 
A ie Le 
‘ 7 5D St ee ae BOSS Te : 8 
‘ 
¢ 4 ae ee 
é oe De oy id ' ies ii) — 
' 4 7 x og ; 
a “= J. . 
a : .. 
Ly x P ‘ c re Pe, iy Poses oy 
a - ’ 
’ 
, rh i 
oa 


htt SO TSM teas eee Lda 

ba : eh " a= ‘ 

, it. : ' a pe J . 

a. Ld 74a Fe ThP : | Le a 9 Ph 

. = Tank? re gy & ‘ 
rh : tae ? Vv ue 4 eee fa 
+ nhoe of Fb DAP ah a 

<n An ena a ot 


is arguing against both the adaptive and the trait theory 
approach since the mechanism for is put individualization in 
the hands of the instructor rather than the student. Is 
Merrill right? Is this really the best way to individualize 
instruction across the entire range Sf individual 
differences related to learning? Or is the adaptive or trait 
approach the most appropriate way to individualize 
instruction? This thesis will also consider this aspect of 


the LC issue. 


There is yet one more side to the LC issue which has to 
do with the task analysis component of CAL. A great deal of 
literature exists in areas such as curriculum and 
instructional design which is concerned with the optinal 
arrangement or delivery of instruction. A good example is 
the sequencing of material to be learned. On the basis of 
much past research, there are many reconmendations made 
cegarding’ the optimal way to sequence a particular subject 
matter or task (e.g<, Bridgs, 1968; Posner & Strike, “1976; 
fennyson, 1972). According to the instructional design 
perspective, there should be optimal ways to organize and 
present a particular subject matter or task and hence 
allowing the student to alter these would always result in 
suboptinal instruction. Clearly, there is no acknowledgement 
of individual differences here. So the question which arises 
is whether , in fact, there can be an optimal instructional 
design for all students and what is lost if the student is 


allowed to modify this. This thesis will explore this aspect 
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of learner control. 


A discussion of learner control within the intructional 
design perspective aust be related to the type and level of 
learning involved, the nature of the subject matter or task, 
the capabilities of the student, and the instructional 
strategies involved. With respect to types and levels of 
learning, problem solving will tend to require learner 
control of one kand whereas learning facts or terminology 
(i.-e., knowledge or comprehension) will tend to necessitate 
another. Problem solving wili require control over the 
instructional procedures or modes while the tearning of 
facts will involve the seguencing of concepts. The same 
contrast is true of instructional strategies. A simulation 
strategy, alrwost by definition, involves conplete learner 
control while a drill & practice strateqy provides little 
room for student choice. In the simulation strategy, the 
learner essentially detersines how instructionally effective 
the program is by the nature of the input he/she provides. 
On the other hand, in drill and practice, control over the 
level of difficuity is probably the - aost impoctant. 
Similarly, different types and levels of subject matter or 
tasks will allow for more or less learner control alony 
certain dimensions by virtue of their inherent structure. 
Thus, acithmetic and topology are both mathematics but would 


involve different structures and control options. 


As the preceding discussion suggests, the learner 
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control issue is a complex one with many difterent inter- 
connected strands. The three main strands outlined above are 
(1) the anstruction and/or learning precesses aspect; (2) 
the individualization aspect; and (3) the instructional 
design aspect. Kach of the aspects jeads to ae slightly 
different formuiation of the tearner control issue which 
implies that any theoretical explanation of learner control 
will have to integrate the essential ideas from three 
different research traditions (1.e., learning, individual 
differences, and instructional theory). The theoretical 
Significance of this study lies in this integration. The 
practical importance pertains to the design of instructional 
software and hence the type of courseware which is and can 
be developed. The ulitisate success of co“zputer-based 
instruction as an educational methodology may depend upon a 
greater understanding of learner control. It is hoped that 
the present study Makes sone contribution to this practical 


problien. 
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IL. Previous research on LC in CAI. 


Learnec Control has become a well studied topic in 
instructional psychology over the last decade. Reviews of 
the literature (e.g., Geis, 1976; George, 1976) have 
summarized the results of these past studies. The following 


Literature review focuses on LC research involving CAI. 


The first study to be discussed does not involve CAI 
but is relevant to later studies. Issing & Eckart (1973) 
compared teacher versus learner control in the context of a 
course on computer fundamentals. The teacher-controlled 
group heard an audio tape prepared by one of a number of 
teachers along with prepared illustrations whereas the 
Student-controiled group were given the illustrations and 
aliowed to interrogate a teacher via a teletype. The 
students were 54 undergraduates. A pretest was used to 
eliminate anyone who already knew something about computers. 
The results of the study were: 
(7) The teacher-controlled sequenceS as conposed by 
different teachers were very Similar. 
(2) The learner controlled sequences (i.e., types and 
patterns of questions asked) were very Similar. 
(3) The feather teontrolied and learner controiled sequences 
were dafterent. 
(4) Students prefered the learner controiled method. 
C5) The teacher-controlled method was more etfLective for 


factual knowledge. 
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(6) Yhe learner controlled method was more eftective when 
transfer of iearning was involved. 

Many of the results were based upon hypotheses generated 

from previous research (e.g., Mager & Clark, 1963; Campbell, 

1964). This study is notable because most o£ these findings 


serve aS Starting points for subsequent research. 


Judd, O'Neil, and Spelt (1974) provide a review of LC 
research whach covers both PI {frogrammed Instruction) and 
CAI instruction. Table 1 gives a summary of nine studies 
done with LC in CAI which are discussed py Judd et al. (most 
of these studies are unpublished technical reports; the full 
citations are given in Judd et al.). AS the Yabie indicates, 
the outcomes of LC research have been mixed with no 
consistent positive or negative findings. (However, only one 
ot the nine studies reports a negative scutcomte with LC; the 
rest are neutral or positive.) Judd et al. suggest that this 
lack of consistency garecres £ron a number of “jog y payieanrayeeu se 
probiems; failure to account for individual differences in 
reaction to LC; Lack of adequate instruction on the use of 
the LC features; lack of appropriate qonenagens feasures 
(e.g. affective); and sinally the lack of consensus on what 
constitutes LC itself. They aiso point out that studies 
which restrict the range of material availabie essentially 


eliminates the need for learner control. 
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The study conducted by Judd et al. was an attempt to 
remedy some of these deficiencies. They attempted to gauge 
(heOVaINe OL LO Dy ucasuriang its effect. on. the use of a 
facilitative variable. The subject matter was a 2 hour 
course on the identifacation of edible plants and the 
subjects were 162 undergraduates. The LC option provided 
access tO a presumably facilitative treatment (anemonic 
aids). The design included two control groups: one which 
received no LC option at all, and the other which received 
the facilitative treatment (mnemonics). They also varied the 
degree Of instruction received on the Lc (brief and extended 
z3nstructions). Their dependent measures were number of 
eIrors, number of LC requests, and responses to a state 
anxiety measure. Individual ditference seasures of task 
specific memory, locus of control, and achievenent— 


independence vere also obtained. 


Unfortunately, the design was unsuccessful because the 
mnemonics had a debilitating rather than facilitating effect 
for most subjects. Thus providing access to wnemonics via LC 
did not have a beneticial eifect on either pertormance or 
anxiety measures. Judd et ai. attributed this unexpected 
result to the heavy memory load necessitated by the 
mnemonics and aiso the facilitative effect of visual aids 
(not finder 2.C. control). The, etfect, of » the extended. ; rather 
than briet instructions on LC were to increase the number of 
LC requests in the first instructional segment. The 


relationships between the indavidual difference variables 
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were unclear due to the failure of the LC manipulation. 


However, a study by White & Smith (1974) found a 
relationship between personality dimensions and learner 
control. The study involved 192 elesentary/secondary science 
education students learning about the use and writing of 
behavioral objectives. The Myers-Briqgs Personality Type 
Inventory was used to identify introverted, extroverted, 
sensing, and intuitive personality types. Four learner 
control groups differed in their control over: 

ie whether oc not the objectives were shown, 

ii. comments on preterences and errors were made, 

Lil. recommendations for next nodule were made, 

ive the seguence of sodules. 
One group had control over i1,14,ii1,iv; the second group had 
control over i,- 13, 111; the third group had control over 
1,141; and the fourth group had no control over these 
parameters. The dependent measures were total 
correct/fincorrect, response time, total time, and attitudes 
towards the subject matter and CAI. The analysis of the data 
was made in terms of the four personality types. The results 
indicated a number of interactions between personality types 
and LC groups. As more control was given to the intuitive 
types, they became less satisfied with the subject matter 
and CAL whereas the SenSing types becane moce satisfied. 
Both the extroverts and introverts tended to perform more 
error-free when they followed a fixed sequence, however the 


tendency was stronger tor extroverts. This study provides 
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evidence for the importance of personality characteristics 


in the effects of learner control. 


Atkinson (1972) studied the etfects of LC with 
university students in a drill & practice program for 
learning German-English vocabulary. Atkinson compared the 
performance of the students using four different strategies 
for the sequencing of word selection: random order, student 
selection, optimal strategy based upon an assumption of 
egual item difficulty, and optirzal strategy based upon an 
assumption of unequal item difficulty. The optimal strategy 
was based upon the predictions of a mathematical learning 
godel for waxisizing the nuwsber of correctly cesenbered 
words. The resultS of these tour strategies showed that the 
Optimal selection rcule based upon unequal item di epren key 
was best in a 2 week delayed retention test followed by the 
student selection strategy which was better than erther the 
random or optimal based: upon equal difficuity strategies. 
However, in terms ot the number of correctly renenbered 
words during the learning trials, the random order and 
optimal order based upon equal difficulty strategies were 
better than the student selection or optimal based upon 
unequal difficulty strategies. Atkinson suggests that in the 
student selection strategy, Students tended to practice 
items they didn't know hence reducing the number they got 
correct while learning put improving thear delayed recall of 
the words. YThis conjecture say explain why the LC group 


a 


showed poorer oc siower learning on the basis of immediate 


ey rer = 
, : >. ’ 
4 ' fi} 4 a * ce ie 4 
, rie, ert 4 as % Ny ie eS ie N, 
Tay 9) airy er t . x hi ‘pf yf . a 7 rs 
: ‘a : rote.) 5 j 
; 7 4 
; or e oh A pl Ae Py re ) io “2 
Leis Yaa ey. tors 
‘ Se a AS y A a) aa oe gs 
eA! Grr is Ung Wen o> re SNe 
i *, J 7 : » + 7 > ni , LY 
ae dat : WS. ; M2 , ; t 
ary Somes ; baie F AAs mae i , a iP 
a Pa ae, + ecu in e . Se et a 
it . A rN : ae : ¥ 
i as YO ee “ts 
7 5 ne EX 
Pr oe ee met : ee 
4 bah ee Das -~ 4 : ‘ © 
Hout, Se TN) ga Tee. en 
y An 7 ; Np 
. 2 - 
, oP . is Leg : 

Fe 2 ic 
way * . Sas Te Pape f - 
Waa | OS es Fags ee 3 ree! ) See 

or ' = fo, = 
i] . e § 
, Fok FT a 
r J x — a= 5 q - 3 , 
wy - ¢ F kwy tore P 
eA O89 is: eset fa A w Yo Rahat 
© = fo aN ra . 
R: «. 
i i A] aes 
. - , " 
es Pe a Be 2 i OD) FeO Weel 
: : 2 Ae 
Mahuste \* - ee fae Cvs 
« ? 
rc 3 ¥] ; ae a4 : } ee { 
= 4 
5 fii ; ve ee i 
ce ne 
a 3 ; Ja 
at : J a cae his | 
7" 7 
F E 
i - 
’ « ‘i. ‘ + ze 
e e é 
| Me - : 
* 
> ; rH ai 
o ep = 
7 ‘ 1 - 4s 
’ a i : } 
en > : 
: i F ‘ 
are | , CE bw F > 
4 . 2 v Tr 
4 4 
2 + 
aif eT. i 
¢ 
‘ 
- # 
: ‘ 4 ad we AGA i 
te 
« 
¥ be 
+ 
2 e 4 
J apt, f LUG 
‘ ~ a : 
; a * 1 « sa < . 
> PRD Ee } : ix 
‘ 3 
1a 4 7 4 a ¢ 
~ rf = ; av s 
~ ; .< ‘ - 
y = ; m 
, ‘ 
<3 ‘ b , sf ’ o> 
- - 
J A 
A 
¢ 3 “y - , 
«Ste ‘ied > ime Pad 2a 
A i 
; =S 2 . 
- oe . } ; a 
+ ae i i a ; 4 , i , 
To, oe ati Ce eee 2 ee mg rt) AS ys 
; . 7 ; iy \ 
i 


i 9988 DS hae - ? ¥ 


een ’ “al : ah 


15 


testing but improved learning in tasks which invelve longer 


retention. 


Fisher et al. (1975) investigated the effects of LC 
with 4th and 5th grade pupils on the Stanford arithmetic 
drill & test program. A yoked LC-control group design was 
employed so that each pupil in the control group received 
essentially the same instruction as the LC pupils. The LC 
options alilowed selection of problems and control over the 
level ct difficulty. The dependent measures were the degree 
of engagement (measured by behavioral observations of the 
ease of distraction from the task by toys) and a locus of 
control measure in which control was defined as the 
attribution of outcomes to factors that can be changed (as 
bepesed “to (fate or tuck). Their (findings. were that L¢ 
students showed significantly greater task engagement and 
more self-directed attribution on the locus of control 
measures. An interesting outcone was that the yoked control 
group completed substantially more probleus than the LC 
group. Within the LC group there were two distinct and 
consistent choice patterns; chiidren who consistently chose 
the easier problems (thus maximizing their performance 
scores) and children who consistently chose harder problems 
(hence minimizing their perforaance scores). This result 
reveals that some students can deliberately lover their 


performance while using LC. 


This last. finding is supported by research done by Pask 
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& Scott (1972) and extended by Pask (1976). In these 
studies, the subject matter was an artitical zoological 
taxonomy ("Clobbits®" and "Gandlemullers"). Individuals are 
provided with different types of inforaation available and 
must learn by selecting certain types of information. Pask 
ciassified learners into two broad learning styles, 
serialists and holists. Serialists learn by means of string- 
like concept links; they assimilate lengthy sequences and 
are intolerant of irrelevant information. Holists learn 
material as a whole; they develop an interrelated system of 
principles which contain arrelevant information. Pask 
describes these two learning styles in considerable detail 
as well as their operational referents. Pask & Scott 
demonstrated that students who were matched on the type of 
information available during their learning task and their 
serialist/nolist learning styie learned hore see ees 


than those who were alisnatched. 


Lahey & Crawford (1976) investigated the effects of LC 
strategies in the U.S. Wavy basic electronic/electricity 
curriculum. Their study involved TICCLY {Tameshared 
Interactive Computer Controlled Instructional Television) 
and atlowed students to select the mode of learning (rule, 
example, or practice) as well as changing the level of 
difficuity. hey reported the frequency of use of each of 
the 16 possible combinations ot rule, exanple, and practice. 
The cesults indicated that students had a strong preference 


toc a cule-exaaple-practice strategy followed by an exanple- 
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practice Strategy. They also feund no difference in the 
order of the strategies used as a tunction of the length of 
time spent on the course or Changes in conceptual difficulty 
and hence concluded that familarization with content and 
difficulty level had no influence on the strategies 
selected. In other words, the results of this study suggest 
that when students are provided with a number of possible 
strategies to use, they tend to rely on one particular 


strategy. 


A subsequent study by Lahey (1978) using the sane 
curriculum addressed the question of whether students would 
do better if they were given advice as to vhat lesson 
content or lesson mode to do next. The performance of three 
groups was compared: a group vith complete learner control, 
a group in which an arrow suggested the next content/uode to 
select, and a group which received the content/mode without 
any choice. There were no significant differences in 
performance between the three groups. On the basis of the 
results of this study as se as Many previous studies, 
Lahey concluded that LC had no signiticant pedagogical 


advantages over adaptive programmed control. 


A study by eso Ree Si (1975) also used the electronics 
curriculum with Naval trainees. In this study, performance 
of a group of trainees whose amount of practice was 
determined by an adaptive brancaing algorithm was compared 


to a group who had contre] over the amount of practice. The 
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results indicate that the LC produced large time savings, 
less variability and higher scores. The data supported the 
conclusion that a knowledgeable student can realistically 


estimate when he/she has mastered the practice material. 


O*Neal (1977) examined the conclusion of the Fredericks 
study. He gave college students varying degrees of control 
over amount of practice and when to take tests in the 
dearning of a hierarchically organized set of APL concepts. 
Students were given the option to take tests when they 
wanted or taking the tests after certain practice conditions 
were met. Jt was hypothesized that students who had conplete 
control over practice wouid not achieve the same degree of 
mastery as those who had to tweet pre-specified gastery 
conditions. fhe resuits showed that there was no difference 
between the groups. it was also hypothesized that learners 
would become more efficient at uSing LC over tine and that 
the LC would result in “more positive attitudes. These 
hypotheses were not supported either. O*Neal concluded that 
students used learner control in such a way as to eliminate 
differences between the aifferent practice groups.» This 
suggests that LC can be usea to compensate for poor 
instructional design {and hence would not be a factor upon 
which groups could be discriminated when the instructional 


design 1S optimal). 


The final study to be reported is a comprehensive one 


by Seidel et al. (1978) which investigated learner control 
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of sequencing in a 30 hour course teaching the programming 
language COBOL. The study investiygatea four sequencing 
variables, three concerned with control over review and 
remedial activity and the other with the sequencing of 
topicse They measured stucent entry characteristics 
(including ability scores and programming aptitude), 
learning strategies in teras of LC usage and circumstances, 
and performance seasures (tities, quiz scores, programming 
errors). They aiso measured the student's level of 
aspiration (LOA) before the quiz for each topic. They 
analyzed the results in terms of high and low performance 
{using a discriviinant analysis) and found that high and low 
performers differed in their use of learner control as well 
as the LOA measure; however, these differences were not 
uniforn for any particular individual across eee 
instructional modules. They concluded that expectations play 
an important role in performance whether indicated by self- 


assessuent or by the learning system. 


These past studies of LC in CAI suggest the tollowing 
conclusions: 
1) LC may be better or worse in terms of performance 
measures than optimized or adaptive programming depending 
upon the appropriateness of the parameters under control. 
2) LC options tend to preduce more favorable aifective 
reactions from students, both towards the subject matter and 
CAI. 


3) When LC options are available, students may use them in a 
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restricted way and this is related to the degree of 
instruction and practice received on LC features. 

4) LC may cause students to become nore deeply engaged or 
involved in the subject matter and hence lead to increased 
learning (as measured by delayed retention tests) 

5) Individual differences ia motivation, achievement, 
personality types, and learning styles will influence the 


use and effects of LC. 


Since the effects of LC have been found to be equivocal 
and varied across previous studies, it Seems important that 
subsequent research be evaluative in nature, a. Cie'g 
investigate LC as it specificaily appiies to particular 
subject matters and student groups. Furthermore, much of the 
past cvesearch has been conducted in the absence of any 
explicit theoretical tiramework. {ft would seem that future 
studies which are developed in the context of a conceptual 
framework: would contribute more to the understanding of LC. 
The next chapter develops a rule-based theoretical basis for 
Le which 1S used: (in. the design of an evaluation study 


discussed in the remainder of this thesis. 
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III. A Theoretical Basis for Learner Control. 


in concluding their review of past research on LC, Judd 
et ats (1974) point out that there exists no real consensus 
on what learner control is. Learner control may reter to 
control over a wide variety of variables including content 
area, Sequencing of instructional units, pacing, review o£ 
help, level of detail or difficulty, or mode of instruction. 
The lack of systematic definition is not too surprising 
because almost ail learner control research 1S carried out 
on an ad-hoc basis and not on the basis of any theoretical 
framework. The present chapter attempts to outline a 
theoretical framework for learner control which may provide 
a more systematic context in which to understand LC. This 
framework incorporates the ideas of many educational 
psychologists such as Ausubel, Bruner, Gagne, scandula, and 
others. Furcthermore, it tries to integrate the traditions of 
learning theory, individual differences, and instructional 


design as they pertain to LC. 


The basis tor the theoretical tramework begins with the 
idea that the root of the learner control issue rests with 
educational goals or purposes -- those belonging to the 
student and the teacher. Those of the teacher presumably 
retlect the requirements and demands of parents, business, 
and society in general. These include goals such as general 
literacy, an appreciation of cultural heritage, certain 


inter-personal skills, etc. The goals of the student reflect 
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personal achievement, prestige, secial recognition, and so 
On. While to a great extent the goals of teacser and student 
will overiap, there are some goals which wiil not be shared 
by both. Differences in educational goals are the basic 


level from which the learner control issue originates. 


Goals are ultimately translated into instructional 
objectives (albeit often very vaguely ftormulated) which 
define what is to be taught and how. As usually defined, an 
instructional objective has three main components: (a) the 
behavior or action to be performed by the student, (b) the 
conditions under which the pehavior is to be elicited and 
evaluated, and (c) the criteria or standard of behavior to 
be achieved to demonstrate mastery of the task or skill. 
Instruction designed to satisiy these three components must 
include certain macro or microstrategies @ to produce the 
desired behaviors, the particuiar content and context which 


specifies’ the conditions under which the behavior is 


fu 


elicited, and sufficient practice to achieve the desire 
standard. biafferences in goals between teachers and students 
(and also within each group) will be transmitted in terms of 
these three conponents. Thus, these three aspects of 
instruction-- content, strategies and standards-- will be 


the major dimensions over which teacher/learner control can 


Ze A macrostrateyy is a global type of ianstructional method, 
ices, drill & practice, tutorial, group discussion, inquiry, 
Simulation, etc., while a microstrategy is the tine gtrained 
techniques such aS shaping, cueing, prompting, chaining, 
etc. 
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vary. 


Content variables inciude those associated with 
deciSions about what material should be included, excluded 
or enphasized and also the inherent sequencing and 
Organization of this material. Instructional strategies 
cover the modes (e.g., inductive/deductive), rates, step and 
task sizes or use of various delivery media. The standards 
include the amount of learning required to mastec a subject 
or task, the type of evaluation, and the frequency of 
reviews. The type of evaluation would include simulation, 
multiple choice, etc., as well as considerations of levels 
(e.ge, according to Bloom's taxonomy). Many variables (e.g., 
aifficulty) will aifect content, strategies, and standards. 
Because of this, control over one aspect of instruction such 


as content will aiso affect strategies and standards. 


We can conceive of content, strategy and standards as 
Pr etnasea phenomena .43 “rhe rules inherent in nu subject 
matter or task are those that detine basic concepts (e.g., 
"things with these attributes are called x"), procedures 
[eeGe,", "tO get (4, YOU ado this); and ene Operations which 
define relationships between concepts and procedureS (@.Je, 
"y is the result of doing this to x"). fhe rules involved in 


strategies may be algorithuws or heuristics designed to 


3. Rules have become a major explanatory construct in 
cognitive psychology. For explications, see Scandura (1972) 
or Segal & Stacey (1976). 
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facilitate the learning of the rules of a subject matter or 
task. For example, the microstrategy of prompting is a rule 
which suggests that when there is a low probability of a 
learner making a spontaneous correct response, then some 
hint or stimulus should be provided which will ensure that 
the learner makes a correct response. While many of the 
rules which comprise instructional strategies are content or 
task independent (such as prompting), many are strategies 
for a particular content. For example, there are many 
strategies used in the teaching of arithmetic with respect 


to how to do carrying, the format of the probiems, etc. 


The cules which reiate to achieving a mastery criterion 
are those concerned with assessing whether something has 
been understood, i.e., cules which help “debug" knowledge. A 
typical rule for assessing whether sonething has. been 
understood is to try to paraphrase it (in the case of fact 
or concept) OL generate a novel result (in the case of a 
procedure). The tiearning ot every subject aatter or task 
produces characteristic errors and a knowledge of these is 
an important aspect of composing successful instructional 


strategies for that subject matter. 


Learning a subject matter thus consists of learning a 


set of rules and their interrelationships.* Because of the 


4“. In fact, it can be argued that the integration of inter- 
relationships between concepts is the more difficult and 
most important aspect of learning. 
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inherent logic of a subject matter, there will almost always 
be some hierarchical structure which demands that some 
concepts or rules be learned before others (Gagne, 19638). 
.Thus, a student must learn to count pbetore dearning 
addition, or learn the basic vocabulary of a language before 
compoSing Sentences in it.> However, because individuals 
ditfer in their prior background of rules and concepts, each 
individual is likely to construct a somewhat different set 
of relationships for a given subject matter. This is 
depicted abstractly in Figure 1. The Figure shows a graph in 
which nodes represent concepts or rules and the arcs 
represent inter-reiationships between them. The subgraph 
shown with dashed lines represents the conceptual structure 
ot the subject matter for student "A" while the subgraph 
With the dotted lines indicates the understanding oi the 
subject matter for student "B". While they have mastered 
aimost the same set of concepts or rules, they have formed 
many different inter-relationships. Thus, both students have 
learned a common subject matter but they have constructed 


their own individual conceptual structures.® For example two 


5. Actually, the word "must" is too strong here. It would he 
possible, though very arduous, to learn to add without 
dearning to count (say by wsemorizing combinations of 
symbols) or to learn complete sentences one by one and not 
understand their individual constituent words. 

6. Figure 1 depicts a rather extreme case. If two students 
have Similar pre-entry Skills and educational background, it 
is likely that there would be considerabie overlap in the 
relationships formed among concepts. In the case of two 
students wath very different pre-entry skills and perhaps 
socio-cultural backgrounds, differences an conceptual 
structures (in the sense of diftterent relationships between 
the Same concepts) are much wore likely. 
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Students could learn the concept otf statistical significance 
in terms of a strictly numerical comparison rule (i.e., if 
higher than critical value, reject), while another student 
could learn it in terms of critical regions on a frequency 
distribution or a confidence interval. Both of these 
students would have a grasp of the concept but they differ 
in how the concept is inter-related to other statistical 


concepts they know. 


This relatively Simple point makes a profound 
difference to a theory of instruction, for it suggests that 
learning depends upon the reconstruction of the subject 
matter by the learner. The constructive nature of learning 
iS a major theme of cognitive theory as espoused by Bruner, 
Piaget, Neisser, and most information processing theorists. 
The important implication of the constructive view is that 
learning must be a cognitively active process on the part of 
the learner and that student involvement is essential to 
building a conceptual structure. It follows that the student 
should be given a means of organizing new knowledge in an 
appropriate way. The constructive view provides a 
theoretical rationale for an instructional system which 
allows the student to directly control the acquisition of 


concepts or rules. 


Reconstruction will be facilitated if the concepts/ 


rules which comprise a subject matter are presented in a 


manner such that they can be easily reorganized by the 
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learner. the nature of the instructional process will 
obviously eftect the way that this reorganization takes 
piace. Thus Figure 1 could also represent two different 
conceptual structures involving the same concepts tor the 
same learner which could have resulted from different 
instructional methods.? There ace a number of theoretical 
ideas which are relevant here. The first is Ausubel's (1968) 
notion of "advanced organizers". Ausubel argues that the 
learning of meaningful information can oniy occur when there 
exists some sort of conceptual scaffolding upon which 
subsequent learning can be built. By providing the student 
With a concise’ but Tich organizer sat’) the beginning’ of ~s 
lesson, the necessary concepts or rules are available to 
assimilate the details ot new concepts or rules. The second 
relevant idea is Bruner's (1966) proposal for ‘spiral 
curricula*®* in which successive instruction elaborates or 
refines previous material. thus each turn of the "spiral* 
provides further depth or scope to a previcus concept or 
rule. Similar to Bruner*’s spiral curriculum idea is the "web 
teaching" proposal of Norman (1976). In web teaching, 
naaterial must be presented in a fashion which Bes the 
student to develop some semantic framework for relating the 
pieces of information to each other and then continues to 
present material which can be related to this framework. Por 


example, in a statistics curriculum, one might teach the 


7. This point is discussed and documented by Mayer (1977) 
for the concepts of sequencing, order and organization. 
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general differences between parametric and non-parametric 
tests and then present individual pairs of tests which 
illustrate in detail these differences. Essentially, this 
suggests a "top-down" approach to presenting material. ‘fhe 
implication of the web teaching idea is that the curraculua 
organization should be designed so that such manipulation by 


the student is facilitated. 


Another relevant idea is Gagne's notion of learning 
hierarchies. Gagne'"s task analyses of many subject areas 
(see, for exauple, Gagne & Briggs, 1974) reveals a 
hierarchicai arrangement otf subskills which appear to 
represent the optimal organization of instruction for a 
particular task. It is possible to think of these subskills 
as representing various levels or types of rules.& The 
farst-order ruies are those inherent in the subject matter 
AtSeit, C.Qe's arithmetic rules, speiling rules or 
grammatical ruies. he? he next level are Piles Lamont 
learning the subject matter as a whole. At a third level are 
rules concerning learning in general. Thus, if one were 
learning Geography, a first-order rule might be: 
®temperature generally declines as altitude increases"; a 


second-order cule might .be: "draw maps to understand the 


Spatial relations"; and a,,.third-order, cule. might be: 
8 .According to Gagne, there would be rules for 


distinguishing certain classes of attributes (discrimination 
and concept learning), rules tor tinding solutions (problea 
solving) and rules for deducing/induciny tacts (principle 
learning) e 
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“regular review leads to less cramming" (this rule is not 
Specific to geography). The third level would correspond to 


“learning to learn". 


The three levels of cules correspond to the three 
ievels of discourse suggested by Pask (1975). Pask proposes 
two levels of object language, L®° for commands and questions 
used directly in the instruction, L1 for commands and 
questions about learning procedures, explanations, or 
overall strategies, and an observation netalanguayge, L* tor 
describing the system, setting contacts, or specifying 
goals. Scandura (1977) has discussed the idea of lower and 
higher order rules where higher order rules are rules which 
act upon other rules (e.g., generalizations). For Scandura, 
higher and lower order rules are defined by their respective 
complexity and context -- a higher order cule could be a 
lower order rule for another higher order rule. Thus, there 
seens to be a good theoretical basis upon which to argue 
that a subject matter/curriculum can be viewed as a set of 
hierarchical rules and further, that;, the -learning . process 
involves acquiring and organizing rules (i.e., strategies) 


about how to learn these rules. 


what about individual differences? It is suggested that 
individual differences be considered as differences in rule 
systems possessed by individuals. While the primary interest 
is with cognitive and perceptual rules, we can also think of 


ditference in social cules (how to interact with others) and 
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moral rules (criteria ter good and bad) which relate to 
personality differences. Classical personality traits (e.g., 
introversion / extroversion, anxiety, authoritarianisa, 
field dependence, etc.) can also be thought of as 
generalized descriptions of rules for dealing with certain 
situations or feelings. There have been a number of atteapts 
recently to reconceptualize ability differences in terms of 
Lules (e.g., Hunt, Frost & Lunneborg, 1974; Carroll, 1976) 
and this work has shown the plausibility of this idea. To 
the extent that students differ in rule systems, they will 
tend to organize and structure material differently. Thus, 
the rules/fconcepts which comprise the subject matter must be 


arranged to suit the ruie system of the individual. 


With this minigal theoretical basis, two ma JOr 
implications for instruction can be identified. The first is 
that curriculum should be organized so that component 
concepts. or “rule are’ distinct and capable of being 
reorganized by the learner. This follows irom the argument 
for the constructive nature eure itiee Concept and rule 
learning research suggests that an abundance of examples 
which iliustrate positive, negative and irrelevant 
attributes are esSential to the efficient learning of 
concepts. Because of individual ditferences in abilities and 
personality, different individuals will require examples of 
differing complexity, difficulty or content. The second 
implication is that the instructional design should include 


the facility for utilizing different levels of rules during 
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the course of instruction. Thus students should be Rates to 
aiter modes of instruction in relation to different prior 
knowledge, difterent learning strategies, or as their level 
of sophistication Within the subject domain changes. 
Finally, there should be the capability to assist the 
student with "local" debugging (i.e., specific problems or 
nisunderstand ing) and also with "global" debugging of 


learning tactics and strategies. 


The above implications suggest that the learner should 
have control over the three fundamental aspects which relate 
to an instructional objective, i.e., content, strategies, 
and mastery criterion. Thus the student has control over 
content if it is possible to aiterc the selection of the 
concepts and the tlevel of difficulty. Control over the 
instructional strategies means the capability to alter the 
sequence of instraction and the presentation modes (e.g., 
exploratory versus expository). Allowing the student to 
control the amount o£ practice, the mastery levels, or 
access to hints or help constitutes control of instructional 


standards. 


The TICCIY (Tameshared Interactive Conputer Controlled 
Instructional Television) CAL system (see Bunderson, 1974) 
provides the prototype of a learner control system which 
allows control over these three major cosgponents. TICCIT is 
organized into 4 levels of instruction, the highest devel 


being concerned with course objectives and student progress, 
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and the lowest level being the primary instructional 
components. The subject matter 1s organized into five 
distinct tiles: maps files (objectives and pre-requisites), 
generality files {concepts or rules), instance files 
(examples), test files, and "fun" files (options). These 
different tiles are accessed via LC. In addition, the 
student can select an expository or inguisitory mode for 
examples and can alter the level of difficulty (easy, 
medium, hard) for either the generalities or instances. 
Learner control is an integral and necessary part of the 
TICCIT system. It provides the weans whereby the student 
directs the sequence of concepts or rules and the examples 
necessary to understand them. It also provides the means for 
monitoring and managing self-progress. The empirical study 
to be reported in the next chapter evaluates most of the Lc 
features represented in the TICCIT system. Since the TICCIT 
system embodies the theoretical ideas developed in this 
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IV. A Learner Controlled APL Course. 


This chapter discusses the design, implementation, and 
evaluation of a learner controlled CAL course to teach A 
Programming Language (APL). £t should be understood that 
this study was conducted from an evaluation rather than 
research perspective. Evaltiation studies are characterized 
by their orientation towards providing sufficient 
information to make a decision regarding the usefulness of 
certain wuethods or media in a particular instructional 
Situation, whereaS research {in the traditional sense) has 
been concerned. with testing the validity (i7.¢e., truth). of 
hypotheses which are intended to be generalizable across all 
Situations (Pophas, 1975). Thus, the study was sainly 
intended to assess how a nutiber of different LC features 
{and aiftferent conditions ot access to the LC) would affect 
the performance and attitudes of the particular groups of 
students tor the purpose of determining the usefulness of LC 
in this particular instructionai context(i.e., learning 
Reet Course, 10-15 hoped that the results will aiso be 
useful in reaching conclusions about the theoretical aspects 
of LC and its role in the developaent of computer-based 


ANnNSCCUCTI ON. 


Furthermore, the course was designed, developed and 
evaluated under "rceal" instructional conditions with 
students who genuinely wanted to learn the subject matter 


(as Opposed to "participating tor course credit"). Errors 
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were corrected and poor instructional sequences improved as 
the course was used and hence the exact content of the 
course changed over time. This runs counter to the usual 
experimental paradigm where all "subjects" within the same 
*treatment” must have exactly the same stimulus conditions. 
However, from an evaluation perspective, such dynamic 
conditions are those which would be found in any legitimate 
instructional context (towards which the conclusions are 
intended) and hence tend to improve the ecological validity 


of the study. 


This chapter is divided into three sections. The first 
discusses the nature of APL as a subject matter and in terns 
of some of the ideas developed in the previous chapter; the 
second describes the design and implementation of the course 
APLLC; and the third presents the method and cesults of the 


evaluation of APLLC. 


APL is a very powerful and concise notational system 
devised by Iverson (1962) which has been implewxented as a 
hagh level programuing language. There are two major aspects 
of learning APL: learning the details of the notation itself 
(iee., the APL symbols and their syntax), and learning basic 
prograaning concepts suca aS wariables, data types, 


algorithus, iteration, branching and so on. Because APL is 
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fundamentally a mathematical system and sone ot the 
primitive functions have specific mathematical content 
(eee, trigonometry, boolean or matrix algebra), the 
mathematical sophistication of the student will play some 
role in his/her learning rate. Similarly, the student's 
previous programming knewledge and experience will aiso 
influence (sometines negatively) the learning of APL. Thus 
programming and mathematical preskills must be taken into 


account in a study of APL instruction. 


An important question in the testing of LC using APL is 
whether or not there is an optimal hierarchical structure 
for presenting APL concepts. Obviously, if there is one such 
structure, allowing the student to alter this via learner 
control will result in suboptimal instruction. On the basis 
of the theoretical frawework developed in the preceding 
chapter, it was suggested that no such single optimal 
structure could exist given the different prior conceptual 
structures and indivadual differences of students and 
therefore the learner should be allowed to reorganize the 


subject matter theaselves. 


Is there any such optimal structure for APL? Table 2 
lists the chapter ‘contents as they are given in. three 
widely-used APL texts: Gray (1973), Gitman & Rose (1970) and 
the IBM Independent Study ttanual (Ibm, 1975). By comparing 
the columns in the table, it can be seen that there is 


indeed considerable agreement between these three authors in 
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the specification of concepts an APL and the order in which 
they should be learned. Thus, ali authors introduce the 
avithmetic primitives and the concept of variables to begin 
with followed by the primitives for logical, relational, 
logarithmic, exponentiation, and maximum PA nhininua 
functions. Function definition and modification follow these 
primitives and then workspaces and system conmands. However, 
apart from this general agreement, there are many 
differences. For example, reduction, function input / 
output, matrices, and branching are introduced at different 
points with different authors. This suggests that as far as 
the inherent logic of APL is concerned, there are a number 
ef concepts which stand in a more or less hierarchical 
relationship (namely, a subset of primitives, variables, 
function definition, system commands) and other concepts 
which can be related to these in various ways {and hence are 


not part of a strict hierarchy). 


Further evidence on this point was collected as part of 
this thesis. O'Neai*® (1977) Beeld learner control in a 
task involving the learning of a subset of APL concepts. 
O*Neal arranged the task structure so that this subset of 
concepts tormed a strict hierarchy as Shown in Figure 2. A 
number of individuals very familiar with APL were given an 
alphabetic List of 11 of the concepts O'Neal used 
("stuiting™ and “counting” were leit out due to ambiguity) 
and asked to arrange them in the best teaching structure. 


The results of this exercise are given in Figure 3. It 
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appears that for this particular subset of APL concepts, the 
hierarchicial structure as perceived by these subject matter 


experts is weak. 


The preceding discussion of organizational structure 
for teaching APL can be summarized by saying that there are 
a huamber of basic concepts with strong interdependencies 
among them (and whica should be organized in a particular 
hierarchical sequence) and a set of weakly dependent 
concepts which can be related to these basic concepts in 
various wayS. These basic concepts are variables and 
assignnent, data structures, primitives, detined functions, 
and system commands (workspaces). It is suggested that a 
Spirally organized curricuium which involves successive 
elaboration of tne basic concepts in 3 or 4 leveis would be 
the best way to organize APL teaching. This suggestion is 
based upon the theoretical ideas discussed in the preceding 


chapter and the organization retlected in major APL texts. 


Table 3 shows the concepts for such a spiral curriculus 
with 3 levels. Level I intxoduces variables and assignment 
for numbers, numerical ana relational primitives, combining 
primitives into algorithms, and error MESSAGES « Only 
numerical scalars and vectors are introduced in this tirst 
level. Level II introduces literais and matrices, sore 
primitives, the operators sum and scan, defined functions, 
system coumands, and errors associated With delined 


functions and system commands. Level III involves the 
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introduction of the remaining priwitives, innec and outer 
products, turther aspects ot detined functions, system 
Variables, and public libraries. Note that at each 
successive level either a basic concept is elaborated (e.g., 
primitives with scalars, vectors, primitives with matrices) 
or a new concept is introduced which depends upon a previous 
one (e.g, defined functions depend upon primitives). This 
stracture also has the property that each levei consititutes 
a coherent unit; a student could guit after each level and 


understand something useful about APL. 


The study of actual APL usage and errors made in APL 
prograzsa@ing exzphasizes the human performance capabilities 
or limitations in the use of APL in contrast to the rational 
analysis of its logical structure. In effect, such 
anfocmation reveals what people actuaily learn (and fail to 
learn). This type of analysis should play as much a role in 
the design of instruction as rational task analysis in terms 
of indicating necessary and unnecessary preskills or 


appropriate levels of difficulty. 


A study by Saal & Weiss (1977) MRoeaeS descriptive 
data on APL usage. Their sample consisted of 32 IBM 
application workspaces ranging over areas such as plotting, 
text editing, linear program@ing, Statistics, and dagital 
circuit design. Their findings can be summarized by the 
following points: 


1) User defined tunctions tend to be short with the median 


a. eer 
PE ea Sat 
a he 


1 
aa 
i % , 
: : Belk ie i bad, " 
* me 
j 
« s. t 
| Pa 
- er T 7 i: 
J ‘ : 
i * cs ; 3 
‘ ee 
=] - 7 i e ; 
" ' er 
hing eran ee te he oe Pees 
rr - = ; a i 
5 ¥ eb’ : se 
\ 
J 3 7 
i 4 ¥ 
iid F a” Ws ~ 
Loe ee t 
; t ; 
} ’ hile 
= 7 
2 SABO: “DAB Nis 
; . 
; . - 
os wy 7 7 
| : ¥ ; eae hi 
, e ; 
. 4 ; ; : 
i \ 
* \ ‘ 
: ’ + os ) b ; 
; F ‘ ; they Gal pe 
; et bis » 
— s 
i Steves 8 ar Derm Bee a ee 
| ; 
2 ; ' ad ¢ : : 
= $ ; | 
: ee aie ha 
4 3 FST tye) EE owe US a 
\ . 
, ae 
a . N 
Baissea Be 20 bathe 
’ > vea 
Raye ry fi ee Ses 
A a; S : 
, 2 ath, eat oe 
, - 
cat 
; 2 
. roa Ras 
; ‘ 
" -\ s 
f ia 7 


4) 


3) 


4) 


9) 


oD) 


8) 


9) 


Be 


length being 5 lines and 20 percent of all = func*ions 
being “1 liners®. 

Internal documentation of code was rare (about 4 percent 
of all Lines). 

Ambiguity due to local / giobal confusion was relatively 
rare. 

Recursion was used in 6 Of 32 workspaces (which may bea 
Sampling artifact). 

90 percent of all APL operations consist of primitives 
and subscripting, ana the use of operators (reduction, 
scan, inner & outer products, catenation) account for 
only 4 percent combined. 

ohew- Seven | pribitiaves spius =) /*anG',)  )*or', 7 *fLroor*, 
‘celiling', ‘times', and *uinus*, account tor 95 percent 
of all reductions while the three primitives, ‘plus'*, 
fand*', *ort,, account for 75 percent. 

in terns of subscripted objects, 56 percent were 
vectors, 43 percent were satrices and only 14 percent 
involved 3 dimensional arrays. 

The ) combinations, of © "plus® dot (tiges® ‘and tand dot 
equais*- aéccountetor lieverta70 (ipercent of tall *anner 
products. 

Three primitives, ‘branch*, ‘row’ (*reshape'), and 
travel? (*catenate'), account for 75 percent of all 
monadic use in APL and the seven primitives: 
fassignment*®, 'plus*, ‘compression’, ‘times', ‘eguais'’, 


trank® / *reshape*, account for 75 percent of all dyadic 


+. 
= 
7 
e 
Lal 
vay 


4 a t 
< “4 : 
no 
j 
é 
ig 
i] 
‘ 
na 
‘- 3 
7 3 
A 4 ’ 
4 ae 
4 
. 
. 


Ne 2.2 TAS da fis aan? 
= ion ta. 7 : ie) ae. au 
¥ oe Pe uy 
bank. teers og (Fae 
( 4 “ti r on} ' hi + 7 
re 26. OS 

cae a | s . es >, 7 oe 

#0 “it uh ii os ie e, ; Re. PAs 


J é 


ule no a2 oa oe hand bay 
: : ea an Ay ails, ei 3 


vel ih ee 


| F : 
Pry debe 


4Q 
USaUe. 


This last point leads to the "80-20" rule, namely that 80 
percent of the observed usage is accounted for by 20 percent 
oi the avaiiable functions. Saal & Weiss conclude that  siany 
features of APL are used extremely infrequently and hence 


could be eliminated from introductory teaching of APL. 


There are three levels of errors which can be made in 
APL programming: (i) function execution errors, (ii) 
WOrLKSpace management errors, and (111) logic errors in 
defined functions. Errors of type (i) give rise to one of 
the eight APL error messages and an indication of where in 
the expression the error occurs. Errors of type (11) arise 
from the use of system commands and variables and also from 
exceeding workspace limitations. Type (111i) errors involve 
errors in function iteration, branching, subroutines or 
input/output and may or mhay not result in explicit error 


messages of type {1i)- 


Table 4 provides some data on the frequency of 
occurrence ox type {1); and Gi) errors in student 
programsing collected as part of the present study. The data 
is based upon 4a Sanele of 148 partial or complete listings 


of terminal sessions® collected from the recycling bins of a 


5. Of the 148 listings, 52 were of complete sessions. The 
average duration of these sessions was 317.4 thinutes using 
2.6 seconds of CPU time. 
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terminal room Over a one month period. The sample represents 
a cross-section ot novice and experienced APL programmers 
across different application areas; the error trequencies 
would undoubtedly differ in nature with programming 
experience and the nature of the application. As Table 4 
shows, function execution errors account for over 91% of the 
total errors in these sessions with value and syntax errors 
accounting for over 504% of the execution errors. Workspace 
management errors account for only apout &&%A Of the total 
errors and about 50% of these are incorrect command errors. 
fhe value errors stem nostiy from unassigned variables; 
however SOme arose trom syntactic mistakes such aS missing a 
Space between a function header and an argument ({e.g., HEANK 
for MEAN X). Syntax errors arise when a function is missing 
its proper argument(s), e.y-, when a dyadic function has 
only one argument. Syntax errors can also arise fron indexed 
variables where the variable name is BMissings As for 
incorrect command errors, the majority of these were due to 
incorrectly spelied workspace,. function, or variable names 


in system conmands. 


The implications’ 'of~ this data for the design of APL 
instruction are twofold. First, given a knowledge of the 
frequency of certain errors, additional emphasis or 
attention should be placed on teaching aspects which are 
highly error prone as well as diagnostic testing to locate 
missing pre-requisite skills or tasks. For exanxple, many 


errors arise because students do not understand how to use 
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arguments in defined functions. Sometimes students do not 
understand the relationship between values used in the 
header statewent and the body of the function -- this 
usually ieads to VALUE errors. Figure 4 shows an example of 
SYNTAX errors acising from a misunderstanding of function 
arguments. This example aiso illustrates the multiple 
causality which can occur in the generation of error 
messageSe Error data suggests that the concept of function 
arguments, particuidarly in defined functions, requires extra 


attention. 


The second implication of information about errors in 
APL is that instruction is needed to teach the student how 
to correct them (i.e., debugging). Each ot the three error 
types will involve different debuyging strategies (rules). 
fvype (i) requires the generai understanding of what each 
error message means and how to use the location intormation 
to isolate the error. Given that execution errors account 
for the major proportion of errors, this clearly should 
receive the wost emphasis. Type (11) errers require checking 
the names of workspaces, functions, or variables (i1-e., via 
FNS, VARS, etc.) or altering the workspace parameters 
1456 ,,.2W5SSLZE, STACK, JERASE, etc.) . Type (214), -errors 
require the teaching of technigues Such as checkpoints or 
tracing in order to isolate iogic bugs. The greater the 
detailed understanding ot these three types of errors, the 


better the debugging rules taught to the student. 
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The above discussion suggests three itevels of rules 
which could be involved in the learning of APL: 
Level 1%: Concepts and procedures ot APL and their inter- 
relationships. These are the rules inherent ia the 
explanation of concepts and principles (expository mode) and 
examples ( inductive node). 
Level 2: Procedures for what and how to teach or learn APL. 
This would include a _ strategy such as the spiral 
organization of concepts. It would aiso include the 
knowledge of APL usage or errors to eaphasize certain 
distinctions. This includes twinor contusions such as between 
the negative sign and the minus operator or more major 
MiSsunderstandings such as correct function argusents or the 
difference between scalars, vectors and matrices. In some 
cases, strategies can be taught to help minigiaze errors,e.g. 
debugging strategies. 
Level 3: Rules about how to learn a programming ianguage. 
This would include the necessity ot having both tutorial and 
practice sessions, how to evaluate mastery of concepts 
(through problem solving), and how to nodity the subject 
matter to suit personal styles. 
These three Levels of rules Should be accounted for in the 
design of an APL course. Moreover, the student should have a 
means of controlling each level of cules. This includes the 
capability to control the selection, sequencing, mode of 
presentation, level of difficulty or amount of practice in 


the context of APL. 
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fhe design and implementation of APLLC 
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APLLCO was written in the COURSEWRITER II danguage and 
implemented on the IsM 1500 system operated py the Division 
of Educational Research Services at the University of 
Alberta. The subject matter of the course is organized into 
two separate files; concepts and examples. The course 
consists of 7 major topics which each comprise about 3-7 
concepts. The concepts are composed of 5-10 instructional 


units. The tepics and concepts are given in Appendix I. 


The LC options were implemented via a "CONTROL" frame 
feature. The CONTROL display is shown in Figure 5. It 
provides six majoc options; crevwiew the present concept; 
branch to the next detault concept; branch to the examples 
for the present concept; branch to the topic index; take a 
comment; or change the difficulty level (easier/harder) of 
the presentation. The selection of examples cowie e a 
display of the available examples for that concept (range 2- 
5). fhe selection of the current concept index allows the 
student to branch to any other concept in the current topic. 
In addition, the concept index allows access to the overall 
topic index so that the student can select another topic. 
The comment option ah’ <p COHTKOL frame allows the student 
to make comments to the course author. The master topic 
index allows selection of two further options; a glossary 
and student progress records. The latter provides the 


student with information about the concepts/ topics which 
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have or have not been covered, the last concept studied, and 


a Summary of pertormance. 


The difficuity level option caused the presentation of 
Simpler or more difficult explanations of concepts when they 
were available. Sometimes, there would be only an easier or 
harder aiternative explanation or only one level. The 
distinction between the easy and difficult levels involved 
the degree of conciseness, redundancy, use of analogies, and 
‘alternative instructional strateyies. Por exauple, the easy 
example for introducing defined functions used a niladic 
function which produced a box; the default level a monadic 
function for computing the mean of N; and@ the hard level 
invoived a dyadic function for text editing. The easy level 
concentrated on the idea of sequential execution without the 
complication of arguments whereas the defauit and hard 


levels introduced arguments at the same time. 


The self-reported ievel of tiathematical and programming 
knowledge was aiso used to select instructional sequences. 
However, anlike the difficulty level, the selection precess 
was automatic and not under the learner's control. Thus an 
individual who has no programing experience would get much 
more elementary and couplete explanations of the concepts. 
Similarly, for those who indicated no knowledge of certain 
mathematical areas, the corresponding primitives were 
bypassed (e.g, no knowiedge of trigonometry would cause 


bypassing the circular primitives). In some cases, there was 
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some overlap between the selection of material which was 
easier/haraer and selection for the Mathematical or 
programming level. For example, the explanation of matrices 
as tables is an easier mode than one used for those with no 


knowledge of matrices. 


The topic index and each concept index contained a 
further feature -- the RETURN option. This feature was based 
upoh a push-dowh, pop-up stack of label locations which 
allowed the student to return to the concept interrupted by 
uSing LC. Each time the CONTROL display was accessed, the 
present.» concept<: was loaded intoc the stack.) The RETURN 
feature allowed the student to interrupt a concept, nove to 
another concept, and then automatically return to the 
interrupted iocation. An unfortunate limitation of the 
particular implementation of the RETURN feature was that the 
Stack had a capacity ot 15 labels per terminai session and 


overflow tesulted in overwriting of the stack. 


festing in the course was of two types: embedded 
questions and unit post-tests. The embedded questions were 
one to three questions which followed the presentation of 
each new concept. Their purpose was to ensure that the 
student understood the immediately preceding instructional 
sequence. Failure to answer the questions correctly cesulted 
in either a repeat of the sequence or remedial sequence to 
correct a specific misunderstanding indicated Ln the 


answer {s) to the guestion(s). Post-tests cage at the end of 
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every concept in the course (e.g., nuserical primitives, 
assignment, error messages, etc.) and usually consisted of 
410 questions covering the entire concept. Learner control 
was always turned off during the unit tests to prevent the 
student irom skipping them. If the student got less than 50 
percent of the post-test questions correct, the concept was 
repeated. If the score was above the 60 percent level, the 
student was branched to the next concept. If the score was 
in the 50 -— 80 percent range, the student was given the 


option of reviewing the concept or going on to the next one. 


The strategy is a buiit-in compromise between giving 
the student full learnec control over the amount of practice 
and degree of mastery achieved and allowing no control. 
Because APLLC was designed to fill a genuine instructional 
role, it was felt that a miniszum level of instruction had to 
be guaranteed if the course was to be instructionally 
effective. On the other hand, in keeping with the purpose of 
allowing the Student to control abe Sr ruc t1one L 
parameters, some control of practice and mastery level was 
necessary. It..is felt .that.the above strategy.allowed 
control over evaluation in the crucial range of decision for 
a learner. It should be noted that the design of APLLC did 
not allow a complete asSessuent of LC with respect to 
allowing students to define the amount of practice and 


mastery levels. 


To susmarize, a course on APL waS implemented with the 
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following LC features (see Figure 5 and Appendix I): 

* the capability to select either a concept or examples of 
a concept for study (next, example) 

* the capability to review a concept or the associated 
examples (repeat) 

* the capability to select any concept in a particular 
topic (concept index) 

* the Capability to select any topic in the course (topic 
index) 

* the capability to use a glossary, study course 
performance or progress of make comments to the course 
author 

* the capability to alter the level of difficulty of the 
instructional presentation (easier, harder) 

* the capability to improve the level of mastery when the 
achievesent level on a unit post-test falls in the 50 - 


80 percent range 


APLLC was implemented in the Pall of 1976 and used by 
about 60 high school students who belonged to computer 
science and math clubs. The LC features were optional and 
could be accessed via a special keystroke at the end of 
every complete screen display (except during post-tests). 
The students received the topics in a default sequence (data 
structures, plimitives, combinations, defined functions, 
system conmands 6 variabies, errors) unless they used the 


learner control to aiter the seyuence or mode. 
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During this time the course was debugged technically 
and instructionally. On the basis of performance records, 
student comments, and comments of other APL teachers and 
experts who went through the course, the course content was 
modified considerably-- terminology waS changed, wore 
embeddea questions were added, and the students were asked 
to type APL expressions for answers as often as possible. 
The most major change was the sequencing and organization of 
the concepts into the spiral structure described in the 
previous section. At the end of the field testing, the 
course was considered instructionaily sound and ready to be 
evaluated with respect to the utility of learner control. 
Thus, the revised form of the course used in the evaluation 
was not tested out betorehand; furthermore, it underwent 


modifications as students began to use it. 


Evaluation of LC. 


Coenen 


The concern of the evaluation phase of this research 1s 
to assesS questions such as: 
1. What are the effects of differing degrees of LC on 
performance and attitudinal outcomes? 
2. Which performance or affective measures are sensitive to 
LC effects (if any)? 
3. What individual difference variables predact and reflect 
the use otf LC? 


We Can both facilitative and inhibitory’ effects be 
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demonstrated for LC for the sane individual in diiferent 
parts of the course or tor ditterent options? 

2. What relative proportion of students snow some degree of 
performance and attitudinal benefit trom LEZ: what 
proportion show no effect?; what proportion show negative 
effects? 

6. How does the use of LC change with the sophistication of 
the student both in terms of differences in pre-entry skills 
and knowledge as well as learning which occurs during the 
course? 

7. If LC results ina siower rate of learning, does this 
reflect a "deeper" mastery or comprehension of the subject 
matter (1.e., greater retention of the material) or lost 


tine due to inefficient course managenent? 


In order to address these questions, APLLC was modified 
to allow for three possible conditions. The first condition 
{no-LC) allowed no LC options whatsoever (eee for the 
capability to wake online cosments to the instructor or 
author). In this condition, the Student received the detault 
sequence of concepts according to the spiral organization 
and a pre-specified exampie for each concept. The second 
condition, learner controi/foptional (LC/0O) had the same 
default sequence and example presentation; however, access 
to the learner control options was available at the end of 
every compiete screen display via a special keystroke. In 
the third condition, learner control/fuli (LC/F), the 


Student was returned to the CONTROL display at the end of 
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every concept or exauple. The selection of the next concept 
or example was up to the student. [ft the student selected 
the next concept option, he / she wouid get the default 
sequence aS in the no-LC condition. Thus, these three 
conditions provided for no, optional, or tull access to the 


learner control features available. 


An explanation of the LC features was given to the LC/F 
and LC/O groups. AS part of the explanation, students were 
Shown the effects of the various LC options and required to 
desonstrate that they could use these options. There was 


not, however, extensive practice in the use of the options. 


Students fros two different groups were candomly 
assigned to one of these three conditions. One group 
consisted of high school students (8=20}) who were learning 
APL as part of a math club activity. The second group 
consisted of graduate students (N=18) who were learning APL 
to be used in conjunction with a course in nultivariate 
Statistics. Fhe university group consisted of about equal 
males and females while the high school students consisted 
mostly of mates. The high school students took the course on 
their own initiative (attendance was voluntary) and were 
probably Par netoaty motivated while the university 
students took the course as part of their class activity and 
hence way have had more of an extrinsic motivation, This 
difference between the two groups in motivation is a 


conjecture, however, and was not measured in any direct way 
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an the study. Furthermore, the nigh school students were 
learning APL as a proyraaming language, whereas the 
university students were learning it as a tool for learning 
statistics. The ditterences between these two groups in age 
and motivations could be expected to produce differences in 
their learning progress and use of LC. In particular, it 
could be expected that the high school students would 
complete the course in Less time and also would use the LC 
features to a greater extent due to their greater interest 


in the subject matter. 


The performance weasures included the total number of 
correct responses from the post-tests for each topic, the 
total tize on each topic, and the ratio of total correct / 
total time. These measures eee the instructional 
effectiveness of the material and also the effects of 
altering the sequence, mode or mastery criteria via the 
Learner control. Students who select extra practice | {via 
examples or reviews) will answer more questions and hence 
have the possibility of having a larger total -correct. 
Similarly the total time can be increased through the use of 
the learner control features. The correct / time ratio is a 


measure of learning rate. 


Two independent measures of learning were wade with the 
university group. When most ot the students were about 
halfway through the course, they were asked in a class 


period to write a tunction to compute the average of a 
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vector. The Second measure consisted of a question on their 
final exam which involved writing an APL function to compute 
multiple regression weights and multiple correiation 
coefficents. These two scores were intended to gauge the 


degree of transfer of learning in the use of APL. 


The attitudinal measure consisted of a 10 item 
questionnaire which was given near the end of the course 
conditional on the student's total time being at least 3 
heurs. The scale was a 5 point Likert type scale with 
“Completely Agree™ at one end and "Completely Disagree™ at 
the other end. The 10 items on the questionnaire are given 
in Table 5. The items were intended to gauge various 
affective reactions to LC and the course. Two of the itens 
ask specifically about the students feelangs of control (6, 
16) while items 1,2,4,7,9 attempt to gauge the learners 
degree of trustration, perception of course organization, 
boredom, Xulfalment ot expectations, and judgment about the 
conpleteness ot the coverage. itens 3,5,8 measure general 
reactions to CAI. Half of the items were negatively stated 


and half were positively stated. 


Three covariate measures were taken; two were concerned 
with preskills and the third with a personality dimension. 


Students were asked to rate their degree of prograuming 


experience as none, some, or experienced and their 
mathematical familiarity with i mathematical areas: 


trigonometry, tactorials, dogarithas, matrix algebra, 
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modular arithmetic, boolean aigebra, and calculus as either 
nil, some, or lots.19 The third covariate measure was the 
dearners score on an internal / external locus of control 
score. The scale consisted of 23 paired items taken from 
Rotter*s (1966) scale with the filler itesgs omitted to 
abbreviate the test. kKotter'’s scale has been found to be a 
reliable measure of an individual's belief in the personal 
control they exert over their life as well as having 
construct validity with other related tests (Rotter, 1966). 
individuals with a high score on the scale manifest a strong 
belief in the external controi of their life by tactors such 
as chance, luck or fate. Individuals with a low score 
manifest a strong belief that their experiences are the 
resuit of their own actions and behavior. Hesearch haS shown 
that internal / externai iocus of control, as measured by 
this scale, relates to many other personality 
characteristics which could be important in instruction, 
@egGe, achievement motivation {McGee & Crandall, 196%) or 
expression of humor (Lefcourt, Sordoni 6 Sordoni, 1974) 
which affects the student's motivation daring learning. of 
all the personality measures which could be made, this one 


would seem to have the most relevance to the use of learner 


10. in addition to providing a measure of mathematical 
level, these scores were used to bypass topics the student 


had no knowledge o£ (€.g-, rea hs a ot 1 Bh & prinitives for 
trigonometric tunctions) or provide rewedial instruction for 
others (eege, matrix algebra, logical primitives). No 


reliability or validity data was collected for this self 
rating measure. 
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control. It shouid be noted that the ommission of the tiller 
items to abbreviate the questionnaire may have affected the 
reliability and validity of the scale and hence any 
conparisons between the results obtained using this 
abbreviated form and research uSing the full form must be 


very tentative. 


To summarize, two ditferent groups of students {high 
school and university) were assigned to one of three LC 
conditions: no learner control (no-LC), optional LC (LC/O), 
and tull LC ({LC/F). Dependent seasSures were total correct, 
total time, correct / time per topic and attitudes at the 
end of the course. Mathematical and programming Knowledge 
and internal / external iocus of control score were the 


concomitant variabies. 


Results Of the Evaluation cr APLLC 


or ccereoont 


Pirst we will consider the use of the learner control 
features for the students who had learner COTECEI capability 
(both LC/o and ILC/F). The total use and percentage of use 
for the LC features is given in Table 6. Looking at the 
CONTROL options, the "next™ and "inagex® features account for 
the largest proportion” of LC ‘use. ‘The naPercetty levels 
(easy/hacd) constituted 25.1 percent of the use. The 


example, cepeat, and comment teatures were used relatively 
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infrequently. fhe LC use in the Topic index aindacates that 
the Piogress Report features were heavily used and that 
students used the Topic index to select another topic about 
15 percent of all LC requests. Since only 15 percent of the 
256 total LC selections from the CONTROL frame were for 
topic changes, we can conclude that only 4% of all LC 
selections were for change of topic overall and that 79 
percent of accesses to the concept index were to select 
another concept within the same topic. As tar as the 
progress report options are concerned, the options of 
concepts done, concepts not done and performance summary 


were about equaily popular. 


The use of LC options via the CONTROL frame combined 
across both student groups is Shown in Figure 6. AS the 
graph Shows, there were diiferences between the total nusber 
of accesses between the LC/O and LC/F for the next, index, 
and difficulty level features. The LC/?¥ group had a higher 
total number of accesses tor the next and difficulty level 
features and fewer index selections than the LC/O group. In 
terms of change over time, the average number of accesses 
between the two groups for each topic in the default 
sequence 1S given in Figure 7. This figure shows that there 
is a considerable difference in use of LC to begin with, but 
that the difference essentially disappears by the fourth 
topic. A one way analysis of variance With the topics as 
repeated measures indicates that the ditferences between 


topics is significant at p=.01 (F [6,60] =5.8). Detailed 
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analysis of the use of the CONTROL features over topics 
indicates that the nunber of accesses to the CONTROL 
features was greatest for the LC/P group for all features, 
except tor the index feature which was most used by the LC/P? 
group to begin with, but more heavily used by the LC/O group 


later. 


These results suggest that the capability to move to 
another concept in the same topic is important to the 
Student while the capability to move to another topic is 
much less so. The Capability to alter the difficuity level 
also appears to be an important LC feature to the student. 
On the other hand, the examples were not well used -- 
perhaps because the illustrative examples in the concept 


explanations were sufficient. 


As far as the difference between the optional and fall 
LC groups is concerned, it is unclear why the LC/O group 
used the index option meee often or Gwhyesthe LCs? group 
changed the difficulty levels more often (Figure 6). The 
trend for the tyvo groups to come together in their agount of 
LC use aS the course progressed hay represent an optimal or 
asymtopic level of LC use that both groups reached. The 
increase in the index feature by the LC/O group over time 
may vretlect the effects of increased practice with the LC. 
This data suggests that there are differences in the effects 
of LC over time, or with practice. In general, the average 


number of accesses to the ditferent features was 
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proportional across ail topics (declining overall), 
suggesting that no difterential change in the use of 


particular LC features. 


The average number of accesses to the CONTKOL display 
for each topic for the two student groups and LC conditions 
are given in Table 7. As can be seen, the high school 
students in the LC/F condition used the LC options nore 
often than those in the LC/O condition in almost all the 
topics. For the university students, however, the LC/O 
condition had more average accesses to the control frame in 
the first 3 topics but less than the LC/F condition in the 
last 4 tepics. Thus, the high school students used the LC 
more than the university students under the full access 
condition whereas the university students used it more under 
the optional access conditions (at least initially).: This 
data suggests that there were differences in the way the LC 
was utilized between ye two Student groups and eave way 
have been due to motivational diiferences, however, these 


ditferences were not statistically significant. 


Fam 


LOO*ing. Now, at; the 7ertects of LC on, the three 
performance teasures, consider first the eifects of no-LC, 
LCvO and LC/F on average total completion times. As Pigure 8 
shows, for both high school and university students, the 
groups with LC took longer to complete the material. 
However, for the university students, the LC/O condition had 


the longest times whereas foc the high school students, it 
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was the LC/P condition. The average total completion tines 
by topic are shown in Figure 9a {university students) and 
Pigure 9b (high school students). In the case of the 
university students, the no-LC group takes less time in 
every topic than the two LC groups except tor topic 4 where 
Cie -no-LC group took longer than the LC-F, but slightly 
less than LC/O. In the case of high school students, there 
appears to be a reversai of the times for the 3. groups 
between the first 3 topics and the last 4. In the first part 
of the course, the no-LC group takes the greatest average 
time with the LC/O taking the least; in the last part of the 
course, the LC/O group takes the greatest average tine with 
the no-LC condition taking the sost time. When these times 
are averaged, the no-LC group takes iess time than the two 
LC conditions. These results suggest that in general, LC 
eptions cause the student to take longer in completing the 
material. This time is probably spent in the organization of 
learning rather than in learning itself. The present study 
does not allow the separation of these two aspects of tite 


utilization. 


Comparison of Figure 9a and 9b (as well as Table 8) 
indicates that the high school students took less time 
overall to complete the course. In terms of ditficulty ievel 
and pre-skills, it would be expected that the high school 
students would take longer, not less tine. The most likely 
explanation of this result is that the uhiversity group were 


motivated to learn APL more thoroughly than the high school 
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students because they needed it to coaplete course work. The 
high school students, on the other hand, were taking it "for 
fun" and were perhaps less diligent. Untortunately, no 
independent measures of performance were made with the high 
school students so confirmation of this hypothesis from the 


present data is not possible. 


Figure 10 shows the average number correct across all 
post-tests for students in each of the three LC conditions. 
It is clear that students in the no-LC group score more 
correct that the LC | groups and that the LC/O condition 
resuits in more correct than the LC/F condition. This 
suggests that with the greater degree of LC allowed, the 
student is more likely to make a larger number of errors. 
This is in spite of the fact that LC allows more practice, 
review, and more exaaples. Table & shows the average number 
correct across each topic for each LC condition. Note that 
the ceils in Table 8 do not represent the same N because not 
all the students in each group completed every topic. Also 
note that the average total re {last column). is the 
average of the totai correct scores of all the student in 
that group and was calculated separate from the scores for 
each’ “topic. "It °ecanvsberr*seen from the Tabie that the 
differences between the scores are essentially the same 
across the three LC groups {except for LC/F in topic 3) 
suggesting the overall difference in number correct waS not 


related to particular topics. 
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Figure 37 shows the ratio of the average number correct 
to average total time across ail subjects for the three LC 
conditions. This ratio is a measure of learning rate, i.@e, 
the number correct per time spent learning. For both student 
groups, the ratio is higher for the no-LC conditions than 
the LC conditions suggesting that the no-LC condition 
resuited in a higher learning rate. For the university 
students, the LC/PF group had lovest learning rate while for 
the high school students, the LCyvO had the Lowest rate. This 
difference between the two student groups reflects the 


differences in total tines discussed above. 


To summarize the results of the performance wteasures, 
it seems that in general the amount of time required 
increases with the amount of LC available and the number of 
correct and learning rate decreases with the amount of LC 
available. In other words, increased use of learner control 
appears to cause the learner to take longer, score fewer 
correct and achieve a lower learning rate. The analysis of 
variance of the three performance measures which 1s shown in 
Table 9 indicates that none of the etfects described above 
is streng enough to be significant at p=.05 except for the 


differences between topics. 


What about the effects ot LC on attitudes? The average 
scores for the 10 items in the attitude survey (see Table 5) 
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for the two student groups and three LC groups is given in 
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Table 10.173 "Completely agree™ was assigned assigned a value 
of 1 while "Completely disagree™ was a value of 5. The 
compoSite score represents the sus of the scores on the 10 
items with the neyative items transformed to the positive 
direction (i.e., they were subtracted from 5). It provides a 
measure of overall positive attitude towards LC and CAL. 
Analysis otf variance on the items between the three Lc 
conditions and the two student groups indicates that there 
were no Significant differences. Thus, there dees not appear 
to be any general attitude difterences between the three LC 
groups for the items as a whole and the composite score is 
essentially the saxe for the three conditions. The responses 
of the university students in the LC/o and LC/F conditions 
relative to the no-LC condition tend to be in the Same 
direction with the exception of item 2. Thus the university 
students in both LC conditions indicated that they felt less 
frustrated {item 1), less bored (item 4), agreed that CAT 
had disadvantages (item 5), felt that they did not need nore 
LC (item 6), that they learned. as much aS they expected 
{item 7), that they would like to have all their instruction 
via CAI (item 8), and that CAI did not allow as much freedon 
as they wished (item 10), in comparison with the no-Lc 
condition. The high school students in both LC conditions 


indicated that they found the material well organized, felt 


oom 


41. Because of problems in the recording of data and 
students not completing the seqnent 2n which the 
questionnaire was locatea, attitude data was available for 
only about half of the students in the two groups. 
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that they would have learned more via traditional classroom 
THSTCUCT LON, "tLuat CAL tas disadvantayes, that more student 
control was needed, and that they would not want to take ail 
of their instruction via CAI. On the xreswaining items, the 
LC/F and LC/O groups went different ways in relation to the 


no-LC group. 


Items 6 and 10 specifically asked about the control of 
instruction. For item 6 ("the course should allow sore 
student controi and seiection"), we see that the LC groups 
reactea in different directions relative to the no-LC group. 
The high school students in both LCvoO and LC/F felt that 
more LC was not needed relative to the no-LC group; the 
score waS the same for both LC conditions. Both Gnvvereits 
LC groups ageed that more LC was needed, however, the LC/FP 
group agreed more than the LC/o Group. POL Ttem 10,7 ("Car 
provides a iot of freedom in tearning™), the LC/F group 
disagreed with this statement more than the LC/O group for 
both high school and university groups. In general, the 
attitude data Shows no Bee eestst ditferences between the LC 


conditions. 


in “order to- identify “any Significant ettects of the 
covariate measures on the attitudes, the mean score for each 
measure was used to divide the students into high and low 
scoring groupS on the measure. For prograsming preskills, 
this divided the groups into those with no programming 


experience and those with sowe experience. The average 
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scores for the high and low programming skills groups across 
both student groups for the 10 items and composite score is 
given In@ethee top of Table 614. ina vgeneral, the | low 
programming skill group disagreed more with all items than 
the high ‘skill group ‘except for-itera 5 ("CAL has lots of 
disadvantages") and item 6 {(*should be more learner 
COWuLOL") 4 oO, they agreed that CAI has lots of 
disadvantages and sore learner control was needed. 
Hotellings T test on the 10 items and the composite measure 
indicated that there were no Significant differences between 


high and low groups. 


The middle portion of Table 11 shows the scores for the 

high and low mathematical skills groups. Only items 5 and 8 
were Significantly different (t-tests, p=.65, 2-tailed). The 
low math group disagreed more with tre statement that 
learning via computers has lots of disadvantages and agreed 
more With the statement that they would iike to take all ot 
their instruction via CAI. Thus, the low math skills group 
be: 


expressed more favorable attitudes towards CAI on itens 5 


and 8. 


The pottom of Tapnle 11 gives the scores for the high 
ands Low » «score groups on kotters* scale. The high scores 
indicate external iocus of control, the low scores indicate 
internal tocus of control. There vas no difference between 
the composite scores ot the high and tow group and no 


systematic diiferences between the item scores for the 
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groups. The low (internal) group agreed more with item 06 
that there was not enough learner control than the high 
(external) group. The low group aiso felt that they had 
dearned less than they expected in comparison with the high 
group. These two responses are in line with expectations 
about internal controlled stuaents preferring more control 
Over learning and not achieving ee own expectations. 
However, in general there was no signiticant difference 
(Hotellings t, F,10,10=0.93, nes.) between the degree of 
internal/fexternal locus of control as measured py Rotter's 


scale or the attitude itess for the high and low groups. 


The final results to be presented pertain to the 2 
programming quizzes given to the university group as 
measures of independent learning. The first quiz (midtera) 
asked students to write a function to compute the average of 
a vector; the second quiz (final exam) asked students to 
write a function to compute regression coetficients. S5oth 
quizzes were scored out of 5. Table 12 gives the means and 
Standard deviations of the scores fcr the three LC 
conditions. AS can be seen tron the Table, the scores for 
both quizzes were the highest for the students who dia not 
have learner control. The students who had LC did not show a 
higher degree of transter in an independent measure of 
learning. Table 13 displays the correlations of the scores 
on the hyd quizzes with 3 pexrtorwance measures and the 
composite attitude measure from APLLC. The data indicates 


that higher scores on the quizzes were associated with less 
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total time and a higher learning rate in APLLC as well as a 
somewhat hegative attitude towards CAI/LC. The negative 
correlation between the quiz scores and the total time on 
APLLC could be due to the fact that the students who already 
knew some APL would have spent less time on APLLC but done 


better in the guizzes. 


In addition to these quantitative results, a few 
qualitative observations are pertinent. From casual 
conversations with students, and their comments made via the 
cotument feature, it was clear that for sone students, LC was 
valuable and for others it was confusing. The former group 
of students seemed to be able to distinguish the content of 
the course from the instructional logic and as a consequence 
were abie to take appropriate use ork the LC features. 
Students who could not do this tended to be confused about 
the use of LC. It also seemed to be important that the 
student grasp the overall structure of the course (in teras 
of topics and concepts) in. order to use the LC; many 
Students who became eanewsed using the LC seesxed to Lack 
this knowledge of the topics and concepts. An elaborate map 
System “as used in TICCIT would be helpful for these 
Students. There were also a number of students who vere 
frustrated because they did not have enough LC; they 
requested iturther features such as backup one trane, 


help/hint mode, and alternative explanations. 


re 


ra oe) SDN ee 


=» 


ey ors ae” 
De r 2 


BTM 


a aera p bab 200M antag tod 


Bh wait soaps Saseoepea | 


mah 


hha = 
rs . aoe, 
<a) o¥ 
. f ~ a! é J 
a - : bl 
a 1 
a Ny =) 
{ve D aa 
m S 
, ! . Sa 
a J a i" 4 - - 
- sa! a 
A 


67 


V. Conclusions and implications of the Study 


The results of this study need to be considered: 
4) an terms of the value or effects of LC in the specitic 
context of a computer-based API course, 
2) in terms of the relationships between LC and the design 
ot CAI systems and, 
3) in terms of the theoretical framework for LC deveioped in 
Chapter 3. 
Each of these considerations leads to conclusions about 
learner control at different leveis of discourse and 
implications for ditferent aspects ot instructional 
psychology. 


Tee Vatne oF LC in APLLC. 


ERNE CMe eee 


The first consiceration involves conclusions about the 
best LC situation tor a CAI APL course. The results given in 
the previous chapter suggest that as far as the effects of 
LC on performance are concerned, increasing the degree of LC 
access tends to reduce pertormance in terms of greater tctal 
time required, fewer average correct, and a lower learning 
ratio as well as producing less icarning transter. In terms 
of the attitude measures, there was no strong effect of the 
LC conditions on aifect, either negative or positive. Nor do 
differences in mathematical or programming preskills or 
differences in internal/external locus of control seen to 


have any major effect on the use of LC or attitudes towards 
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to LC. Taken together, these results suggest that in this 
particular instructional context, LC does not seem have any 


beneficial effects on performance and attitude measures. 


On the otner hand, some of the LC features were heavily 
used, suggesting that they were indeed important to cexctain 
Students. The capability to branch to other concepts within 
the same topic, to alter the difficulty level, and to 
examine progress were popular options. Thus, even though the 
results suggest that LC is not beneficial to learning 
progress in general, it is clear that the LC features were 


were useful in 


@ 


used considerabiy by some students (and hence 
some way to these students). Qualitative observations during 
student sessions also support this conclusion. Some students 
used LC to review and cross-check new material with that 
already learned.12 Given these circumstances, it seems best 
to compromise and allow the LC features to be used 
optionaily, but provide a default sequence and structure to 
maximize performance. It would not be a good idea to provide 
students with tull LC, at least as tar as the present type 


of LC is concerned. 


Because this study was designed specifically as an 
evaluation study, the above conclusion regarding LC is only 
relevant to the particular instructional context 
42. This suggests a major limitation of the design of the 


study, ieee, the lack of a within individuals coaparison for 
the effects oi learner control. 
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investigated here (i.e. the particular student groups and 
subject matter). Most of the students taking APLLC (in both 
Student groups) did not Know any APL beforehand and wost had 
no programming experience. Students who already knew some 
APL or were experienced programmers may have produced 
different results with the LC since they could be expected 
to already possess a conceptual structure of APL to build 
upon. Even though a {seltj) rating was made of the students 


mathematical and programming experience, this single 


G 


quantitative measure is likely too crude to be useful. What 
is reaily needed is a qualitative measure of the student's 
conceptual network in terms of programming or tathenatical 


knowledge. 


The course was tutorial in nature and this probably 
affected the vaiue and usage of LC. The tutorial mode of 
instruction provides a fairly strong instructional structure 
(i.e., presentation, question/problea, response, response 
analysis, teedback, branching). A subject matter or task in 
Which the concepts ana Bee caren are less hierarchicai in 
hature (e.g., psychology, english, geography, etc.) may 
benefit more significantly from LC. It seems likely that a 
problea solving or inquiry strategy would have lead to 
different effects since the learner control would have been 
more crucial to these types of strategies. Finally, because 
of the inherent hierarchical nature of APL, it may not bea 


subject matter which is enhanced by LC. 
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The results also cover only one particular vay of 
implementing LC. Alternative metnods of providing LC might 
produce different results. For example, in the TiccrT 
system, the LC options are implemented as special keys on 
the keyboard. This way tacilitate the use of LC by making it 
more phySically accessible. A zOLre general way of 
implementing Le would be to provide the student with a 
control Jtanguage which allows the specification ot 
instructional parameters in a fora such as: 

SHOW HARD (ER) ERAAMPLE 

BACKUP ONE CONCEPT 

PROVIDE ALTERNATE BXPLARATION 

SKIP CONCEPT 

SUGGEST STRATEGY (IINT/HELP) 
Such a control language would allow the student to have a 
finer degree of control over the instructional variables. Of 
course whether such a generalized LC is beneficial to 


iearning still remains to be assessed. 


GMs os Opie we consideration is that aithough students were 
required to demonstrate their understanding of the LC 
options, they did not have an opportunity to explore the 
consequences of trying out ditferent learning strategies. 
Thus, it is possible to interpret the results of this study 
in terms of the effects of different degrees of learning how 
to use LC rather the actuai effects of using LC to learn. 
Because students have had Little experience with a learner 


oT] 


control mode of Learning in traditional instruction, a major 
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problem with any LC study is ensuring that the results are 
not due mainly to the amount of practice achieved with the 


LC. 


LC and the design of CAI systems. 


These retiarks bring us to a discussion of the second 
major consideration, nanely, how LC relates to the 
aevelopment of CAI. The introductory chapter discussed how 
the perspectives on the role of student control in learning 
differs between CAI and CAL advocates. The type of LC 
investigated in this study is within the tradition of frane- 
oriented CAI in whicn iessons are constructed on a frame by 
Seave’ Dasis. However, there “are “a Tew * “inteiligent™ “CAL 
systems 43 such as the Basic Instructional Project (Barr et 
ale, 1976) or SOPHIE {Brown & Burton, 1975) and SCHOLAR 
(collins et alF3° 1975) ino which LC is’ an “integral “part “of 
the instructional process. BIP is a prograuming Laboratory 
which consists of a curriculum network that 1S tapped onto 
the programming skills mastered by the student. The systea 
13. The term “intelligent” CAI refers to the idea that the 
system itelf should possess an understanding of what the 
student is doing and the effects of certain instruction 
actions on student learning. Examples of “intelligent” 
Capabilities would be the ability to compare two paraphrases 
of the sane idea and correctly identiiy them as the Same, to 
be able to deduce or ainter why a student has answered 
incorrectly and them construct a teaching sequence to 


correct the misunderstanding, or to check Lor inadequacies 
or inaccuracies in the subject matter provided. 
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automatically selects problems which involve skills the 
student is Yready to learn. The student directs the actual 
dearning process by commands which control instruction, the 
BASIC interpreter, or elicits information and problem 
solving/Y debugging aids. Thus, HIP involves a haghly 
organized task domain with well defined concept inter- 
relationships but the student fully controls the sajor 


parameters of learning. 


SCHOLAR and SOPHIE are prototype socratic systems which 
engaye the student in an instructional dialogue in natural 
language. The system incorporates heuristic strategies for 
teaching certain concepts and helps students test their 
understanding of the subject matter. However, the student 
controls the course of Learning via the specific inforaation 
elicited and questions asked. The major distinction between 
traditional frame-oriented CAT and these “antelligent" CAI 
systems is that the Jdatter are organized as knowledge 
networks which represent an understanding of a subject 
matter. By providing the student with .a high . level 
interaction capability (either a poweriui command language 
or natural language), the student can Jlearn from this 
network in any manner desired with intervention when the 
student needs help or guidance. Adding LC to traditional CAL 
(as in the present study) is really an attempt to nove 
frame-ociented organization towards an “intelligent” network 


organization. 
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However itor LC to really become an integral and 
significant part of computer-based instruction, it will be 
necessary to develop methods cf qualitatively representing 
what the student presently knows about a subject (i.e., the 
student's conceptual structure) in terms of the detailed 
facts, concepts, procedures, etc. when such a wodel of the 
student's knowledge exists, it will then be possible to 
compare the task/subject matter structure with the 
conceptual structure of the student and determine exactly 
what skills the student has already mastered and what is 
needed next. This would permit the system to determine what 
Kind and how much LC is appropriate to optimize the learning 
environment. The task selection algoriths of BIP and the 
"student models" developed by Self (1974) are steps in the 


direction of qualitative representation of stucent progress. 


Theoretical Implications. 


The third and final consideration relates to the 
theoretical framework tor LC. The data suggest that the 
capability to branch to concepts within the sake topic is 
more important than the capability to branch to other 
topics, i.e., that the wore important type of sequence 
control is local rather than global. In other words, in 


developing a conceptual structure of APL, it was nore 
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important to be able to link concepts closely related (i.e., 
at the same level .§ of discourse) than those mOre 
hierarchically related (at different strata). In terms of 
mode, students did not wake much use of examples suggesting 
that an inductive mode was not important and that exposition 
of concepts was sufficient. The heavy use of the progress 
features suygests. that self-evaluation of progress was 
important in terms of what had been covered and performance 
level. This provides evidence that self-monitoring and the 
formulation of rules about how to learn a subject matter was 


attempted. 


The failure of the measures of knowledge level in 
mathematics and prograszming and inner/fexternal locus of 
control to aifect performance or attitude measures is 
puzzling since these characteristics should make a 
difference to the learning of APL and the use of LC. It is 
possible that the self-report of mathematical and 
programming knowledge did not produce accurate or detailed 
enough measurement. It is also possible that the differences 
in the two groups studied were not very great and hence not 
strong enough to produce any effects. it could also be that 
the particular tutorial structure of the program was too 
narrow to allow such differences to manifest any significant 
eifects. It is well known that individual differences tend 
to be mininized when the task or situational demandS are 


Strong. 
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The failure ot the LC groups to score higher in the 
programming quizzes casts doubt on the idea that decreases 
a0 performance duting learning are due to a greater 
organizational effort which will result in better permanant 
dearning and retention. In terms of the theoretical ideas 
developed in Chapter 3, allowing greater freedom to the 
student in the reconstruction of the subject matter should 
facilitate iearning. However, it is also possible that this 
freedom can interfere with learning if an optimal strategy 
is already inherent in the subject matter tor the tmajority 
of students. It is possible that the organization of APLLC 
represented an optimal presentation for these particular 
students and that the LC reduced the etfects of this 


organization. 


In conclusion, the study attempted to. investigate the 
effects of differing aspects of learner control in the 
context of teaching APL. The overail outcome waS that the 
learner control, as implemented, did not produce more 
effective learning and made no Significant difference in 
student attitudes. This outcome is Likely due to a nuaber of 
factors which were not accounted for in the theoretical 
framework developed in Chapter III. introducing learner 
control to a tutorial coucse is not likely to make much of 
an impact, particularly it the task or subject matter 
involves an inherently hierarchical structure or requires 
the development ot problem solving skiils. tihat is sore 


likely to have an impact is an entirely diiferent 


To 


instructional approach in which LC is an antegral part, 
e-ge, the problem solving laboratory style of BIP or the 
Socratic style of SCHOLAR or SOPHIE. Individualization 
Should be based upon a dynamically constructed model of the 
learners® skills and knowledge in terss of the subject 
matter. In other words, to exert a truly important effect on 
instruction, learner control implies a different type of 
interaction between the student and computer. The overall 
conclusion’ "of this’ study,* then tis thatthe (potential 
benefits of learner control were likely overshadowed by the 
mismatch between the characteristics of the subject watter 
and learners and the general instructional approach. 
However, this conclusion can not be sade directly from the 
results of this study and hence is a hypothesis tor further 
research. 


Suggestions for further research 


eee ee tee eI Poe) 


Further evaination of the value of LC in the teaching 
of APL should be conducted in the context of a nore 
appropriate instructional strategy, i.e., a problem solving 
laboratory. LC should be an integral component of the 
instructional process, i.e-, in the form of a command 
language used to direct the course of learning or as part of 
an intereactive dialogue with a socratic tutor. Based upon 
inferences about the student's learning styles and current 
APL knowledge (in terms of APL skiils/facts) as well as 
interences about misunderstandings based upon typical 


student errors, the system should attempt to guide the 
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Student to mastery of APL skiils and maximize performance. 
in doing this, the system would encourage patterns of LC 
which achieve this goal. However, since each student can be 
expected to make use of LC in different ways and to 
different degrees otf effectiveness, this pattern of Lt will 
be highly individual. Thus, some students may do best with 
control over a tew instructional parameters while others may 
do best with a wide range of options. Furthermore, it may be 
most effective to provide the student with certain options 
in one part of the course {e.ge, the beginning) and other 


options in another part of the course. 


In essence this suggestion amounts to a Bh pate eurinty teeny 
for the study of how to properiy baiance student and 
computer control in an individualized manner. After a fairly 
complete review of LC research, Steinberg (1977) also 
recommended this direction for future LC studies. It is 
clear at this point that LC is not an instructional variable 
in itself, but rather a description of the interaction of 
other ianstructional variables {a higher order variable?) and 


needs to be studied as such. 
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TABLE L 


Studies of Learner Control in CAL from Judd ee al. (1974). 


Subjects 


Study 


Grusb (1969) $0 [8M trainees 


Dean (1969) 129 4-4ch graders 


Newark (1970) 26 univ. students 


Barres (1370) 214 3-13 graders 


Olivier (1971) 176 univ. scudencs 


Judd et al. (1979) univ. students 


Mucd ate al. (1977) univ. studencs 


Gallager et al. graduate students 


(1970) 


McCann at al. (1972) U.S. Navy trainees 


Curriculum 


elementary 
staciseics 


arithmetic 
com. prog. 
multiplication 


Xenograde 
3ys Cams 


nathenacics 


nachematics 


aleccronics 


LC Manipulation 


sequenca of chaptars 
(within & between) 


control of amoune 
of practics 


control of sequence 
and pacing 


selection of problen 
cya 
sequence of segments 


sequence of seguents 


amount o€ oractica 


sequence of segments; 


gequance of modules 


Results 


LC gp (within) 
scored becter on 
poscege 


LC gp seared 
better on postese 


LC gp showad becter 
ratantion, tock less 
time 

ao differences 


LC zp did gsooter 
than control 


no diffarences 


LC gp workad nora 
problems than controls 


LC gp shoved lower 
state anxiety levels 


no differences on 
perforsance, LC gp 
mad aore *vea atritudes 
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Jable 2. 


79 


Comparison of Concept Sequencing from Three APL Texts. 


IBM (1976) 


1.Using terminal 
ZeArithmetic fns 


. 3.Variables 


4 .Expressions 

5 -Parentheses 
6.List operations 
7.List indexing 

8 Min/Max 

9 .keduction 
TG.Tables farrays) 
41.Fns definition 
412.Fns editing 
t3.LOcdl/giobal 
W4.Branching/loops 
eek UGat/ 
46.Catenation 
17.Syst vars 


Gilman & Rase 
(4970) 


1.Using terninal 
ZeArithsetic £ns 
3.Exponentials 
4.Logaritéams 
5.-Hin/ax 
o.«KkeSsidue 
7.keLations 

8 Variables 

§ .keduction 

40. .Combinations 
tt.Bumerical fis 
12.Fns editing 
13.Ffns editing 
té.locai/giohal 
t5.Syst Cmds 
16. .Catenation 
W-Indexing, 
1&8 .Mixed f£ns 
49 .Encode/decode 
20 -Hranching/ioops 
21.Arraeys 
22.Transpose 
23.Inner/fouter opr 
Z4.Fne 1/0 


ranx 


Gray (1973) 


1.Using terminal 
2.V¥ariables 
3.Aritmetic ins 
4. Logarithpic ins 
5.Exponential fns 
6.%in/hax 
7.kesidue 
8@.Arrays 
GJeRankACatenate 
10.indexing 
41.Fns detinition 
12.¥nS editing 
13-iocal/giobal 
14 .branching/Loops 
15 Reduction 
To.inner/fouter cpr 
47.Sorting fins 
18.Permuting fins 
19.Set fns 
20.Encode/daecode 
21.Fnc i/0 
22.-£Erors 

23.Syst Cnds 
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Level TI 


Level II 


Level IIr 


Table 36 


Spiral Sequencing for Teaching APL. 


Variabies and asSsignient (numerical) 
Data structures (scaiars and vectors) 
Primitives (numerical, relations) 
Combinations (algorithms) 

Error nessages 


Variables and assignment (literals, matrices) 

bata structures (matrices) 

Prigitives (loyical, selection, structural) 
perators (sum/scah) 

Defined Functions (definition, editing) 

System commands 

Kkrrors (workspace, detined fns) 


Primitives (circular, format, execute) 
Operators (inner/fouter products) 

Defined Functions (branching, ioops, I/O) 
System variables 
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Table 4. 


APL Error Frequencies. 


Total Errors Percentage 


Function Execution 1137 91.8 
VALUE aad 2526 
SYNTAX 314 25 24 
DEFR 217 7.5 
END RY 137 301 
DOMAIN 50 h.O0 
LENGTH 34 Par ae | 
RANK 34 Zul 
INDEX 28 2.6 

korkspace Management 166 ° 
INCORRECT COBHAND 52 ° 
WS KOT FOUND 26 e 


NOT SAVED 

NOt FOUND 

WS FOLL 

STACK FULL 

ROT COPIED 

SYMBOL TABLE FOLL 
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Table 5. 


Attitude Questionnaire 


I often feel frustrated while taking this course. 
The material in this course is well organized. 


It would have been better to learn this material in the 
usual classroom rather than via computer instruction. 


I never find this course boring or dull. 
Learning by the computer has a lot of disadvantages 


I think the course should ailow more student control and 
selection. 


I am not learning as much from this course as I hoped I would. 


I would like to take ail of my instruction through the 
computer. 


There are some aspects of APL that I vould have lired to 
explore further if I had been able to. 


40. Using the computer to learn allows you a lot of 


freedom in learning. 
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Table 6. 


Use of LC Features. 


Total Accesses 


CONTROL FRANE 
Easy 
Hard 
Conuent 
Index 
Exanples 
Next 
Repeat 


TOPIC INDEX 
Ail topics 
Progress 
Glossary 
Return 


PROGRESS FPRAKE 
Last concept 
Topics done 
Topics not done 
Performance 


82 
WHS 
29 
256 
oye! 
267 
45 


54 
195 
Hy 
69 


30 
72 
10o7 
91 


Percentage 


SS ene 
16.8 
3.3 
2960 
6.2 
aes 
5.1 


15.0 
54.4 
11.4 
Wee 


16.0 
24.0 
35.7 
30.3 
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Table 7. 
Average Nuitiber of Accesses to the CONTROL Frame According to Course 
Sseghents. 


Ssegnent 
1 ie 3 4 5 6 7 Avge 
H.eSe ee Osh) 3.8 63.6, 320) 3.6) be eee 
(i =6) 
LC/O 
Univ. UF oles. Sea 166) Veo led Os G4) 2a Ty, 
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H.S. Rog > 1G.0 9.6 3.8 F502 825) 14.8) Sa 
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Table &. 


Total Average Correct. According to LC Conditions for Each Seywent of 
APLLC. 


Segments 


1 2 3 & IS) 6 7 Total 

Ro-LC AtoZ 4256 BILO oe WA al eee oT 
(N=5) 

Univ LC/O Thee Velho oor NU cams Loe 2120) 
(N=6) . 
LC/P a6 667.8. Gh.2 15.0 4120.0-0 8204 318 
(N=5) 
No~LC 4527 2664) TRS 7720. 9. 477,.6.0 V=— 122 
(i= 7) 

Hess LC /0 1205 (1708 59.0 Get tied) 10.0 05.0 791 
(N=6) 
LC/F Soh 22 COLT. O) Pea et ttt Boo GOT 


(N=5) 


Results of 


Performance Heasures 


Completion tines 
Topics 
interaction 


Total correct 
fopics 
Tnteraction 


Time/Correct ratio 
Topics 
Interaction 


Table 9. 
ANOVA fox Performance Keasures. 
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0.10 
32.7 
0.32 


0.63 
32.43 
0.65 
0.56 


22.6 
1.63 
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; Table 10. 
Average Kating of Attitude Items According to 
5=disagree). 


Itess 


ete a 2 eT ge be Mage ye Ps Mali. 
(N=3) (0e6) G.2) O26) (1.1)-4.2) G-0)°0 


HeSk 2 Ba as ok eed, eee 
(N=3) (0.6) (0.0) (0.6) (1.0) (4.5) G@.2) Gus 


Univ. pees wai Pay Wa on) ar as dl PSD a 

(N=6) (1:3),0-2) 0-8) G23) G20) 4.9) ca 
LC/o 

Hos Gua, L7G ie ae 
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LC Conditions (t=agree; 
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Note: Standard deviations are in brackets below means. 
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Table 17. 
Average Attitude Ratings for fiagh and Low Scores on Mathematical and 
Progratiming Measures and Internal/External Locus of Control Scaie 
(i=agree; 5=disaygree). 


tens 
1 Z 3 4 S 6 7 8 9 16 Comp. 
Progremming Level 


High (N=8) Ae eiy 4. 0 
: (0. ) VG D c: D Gr a: 2 a 1) (1: j a: 6) (20) (026) (3.8) 
Low (N=13) 2 


a ) G22) a! D a. ‘0) Ga. ) a! 3) Qa: 72) a 3) oe 5) a: 5) ae a 


Mathematical Level 
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Internal/External Locus of Control 
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Note: Standard deviations are in brackets below means. 
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Table 12. 
Means and Standard Deviations of the Scores on the Programming Quizzes 
for the University Students. 


Quiz 1 Quiz 2 
Mean SoD. Mean Selhe 
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Table 43. 
Correlations Between Scores on Quizzes and Performance or Attitudinal 
Measures irom APLLC. (N=16) 


Quiz 1 OuLzZ Ss 
Total time —.60 ‘ —.09 
Total correct e 16 05 
Total Correct/tite 67 -4£0 
CAI/LC attitude = ae —-.48 
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FIGURE. fi 


Network representation showing two different subgraphs which 
contain the same nodes with different interrelationships. 
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CONCEPTS 


Assignment to variables 


. Comparative signs 


Compression 
Exponentiation 
Max/Min 
Parentheses 

Right to Left Rule 
Residue 


sitakere = Drop 


Vector Arithmetic 


. Vector Indexing 


Task Structure for I!1 APL Concepts from 0'Neal (IS 77) 
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Figure 3. Task structures generated by 4 APL experts. 


VR«A FIB 
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Figure Sa. Average Total Completion Time by Segments 


for the University students. 
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Figure 9b. Average Total Completion Time by Segments 
for the High School student group. 
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Figure 10. Average Total Number Correct according 
to LC Conditions and student groups. 
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Vite APBENDIX 1 


The following photographs ot screen displays illustrate 
the concept indicies for the 7 topics in APLLIC, the topic 
index, the progress record wena, and the nature ot the 


performance summary available. 
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